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ABSTRACT 



In 1290,. the National Assessment of Educational Progress 
(NAEP) included a Trial State Assessment (TSA) ; for the first time in NAEP ’ s 
history, voluntary state-by-state assessments were made. ..In 19.94, TSA was 
expanded to include non-public school students. The 1994 reading assessment 
considered students' proficiency in situations that involved reading 
different kinds of materials for different purposes. The fourth-grade 
assessment measured two global purposes for reading- -reading for literary 
experience and reading to gain information. In Montana, 2,501 students in 111 
public schools were assessed. This report describes the reading proficiency 
of Montana fourth-graders and compares their overall performance to students 
in the West region of the United States and the nation (using data from the 
NAEP national assessments) . The distribution of reading results and reading 
achievement level results are provided for subpopulations of students 
(race/ethnicity, type of location, parents, educational level, and gender) . 
Reading proficiency and achievement of non-public school students are 
separately reported and compared to public school students. To^ provide a 
context for the assessment data, participating public school students, their 
reading teachers, and principals completed questionnaires which focused on: 
policies and practices related to reading (time for instructional activities 
and instructional resources for reading) ; delivery of reading instruction 
(instructional materials and activities, workbooks/ worksheets/writing, 
discussion and group activities, time to read, reading and use of libraries, 
assessing progress in reading) ; reading instructors (preparation, experience 
and professional development); students' home support for literacy (reading 
outside of school and in the home and hours of television watched per day) . 



The average reading proficiency of fourth-grade public school students in 
Montana on the NAEP reading scale was 222 compared to 212 nationwide. (SR) 



What is The Nation’s Report Card? 



THE NATION’S REPORT CARD, the National Assessment of Educational Progress (NAEP), is the only nationally representative and continuing 
assessment of what America’s students know and can do in various subject areas. Since 1969, assessments have been conducted periodically in 
reading, mathematics, science, writing, history/geography, and other fields. By making objective information on student performance available to 
policymakers at the national, state, and local levels, NAEP is an integral part of our nation’s evaluation of the condition and progress of education. 
Only information related to academic achievement is collected under this program; NAEP guarantees the privacy of individual students and their 
families. ^ 

NAEP is a congressionally mandated project of the National Center for Education Statistics, the U.S. Department of Education. The 
Commissioner of Education Statistics is responsible, by law, for carrying out the NAEP project through competitive awards to qualified organiza- 
tions. NAEP reports directly to the Commissioner, who is also responsible for providing continuing reviews, including validation studies and 
solicitation of public comment, on NAEP’s conduct and usefulness. 

In 1988, Congress established the National Assessment Governing Board (NAGB) to formulate policy guidelines for NAEP. The Board is 
responsible for selecting the subject areas to be assessed from among those included in the National Education Goals; for setting appropriate student 
performance levels; for developing assessment objectives and test specifications through a national consensus approach; for designing the 
assessment methodology; for developing guidelines for reporting and disseminating NAEP results; for developing standards and procedures for 
interstate, regional, and national comparisons; for determining the appropriateness of test items and ensuring they are free from bias; and for taking 
actions to improve the form and use of the National Assessment. 
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In 1988, Congress passed legislation for the National Assessment of Educational 
Progress (NAEP) that continued its primary mission of providing dependable and 
comprehensive information about educational progress in the United States. In addition, 
for the first time in the project’s history, the legislation also included a provision 
authorizing voluntary state-by-state assessments on a trial basis. 

As a result of the legislation, the 1990 NAEP program included a Trial State 
Assessment Program in which public-school students in 37 states, the District of 
Columbia, and two territories were assessed in eighth-grade mathematics. 1 The 1992 
NAEP program included an expanded Trial State Assessment Program in fourth-grade 
reading and fourth- and eighth-grade mathematics, with public-school students assessed 
in 41 states, the District of Columbia, and two territories. 2 

The continuation of NAEP’s Trial State Assessment Program in 1994 was 
authorized by additional legislation that enlarged the state-by-state assessment to include 
non-public school students. In addition to the state assessment program in reading at 
grade 4, the 1994 NAEP involved national assessments of reading, world geography, 
and U.S. history at grades 4, 8, and 12. The 1994 Trial State Assessment Program was 
conducted in February 1994 with 44 participants (41 states, the District of Columbia, 
Guam, and the Department of Defense Education Activity [DoDEA] Overseas Schools). 

This computer-generated report describes the reading proficiency of fourth-grade 
public school students in Montana, the West region, and the nation. The distribution 
of reading proficiency results and reading achievement level results are provided for 
groups of students defined by shared characteristics: race/ethnicity, type of location, 
parents’ education level, and gender. Contextual information about reading policies, 
instruction, and home support for reading is presented for public school students. State 
results are based on the representative sample of students who participated in the 1994 
Trial State Reading Assessment Program. Results for the region and the nation are based 
on the regional and national representative samples of students who participated in the 
national NAEP assessment. 



For a summary of the 1990 program, see lna V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. 
The State of Mathematics Achievement ; NAEP's 1 990 Assessment of the Nation and the Trial Assessment of the States. 
(Washington, DC: National Center for Education Statistics, 1991). 



For a summary of the 1992 assessment of reading, see lna V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The 
NAEP 1992 Reading Report Card for the Nation and the States. (Washington, DC: National Center for Education 
Statistics, 1993). For a summary of the 1992 assessment of mathematics, see lna V.S. Mullis, John A. Dossey, Eugene 
H. Owen, and Gary W. Phillips. NAEP 1992 Mathematics Report Card for the Nation and the States. (Washington, 
DC: National Center for Education Statistics, 1993). 
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School and Student Participation in the Reading Assessment 

In Montana, 111 public schools participated in the 1994 fourth-grade reading 
assessment. This number includes participating substitute schools that were selected to 
replace some of the nonparticipating schools from the original sample. The weighted 
school participation rate after substitution in 1994 was 89 percent for public schools, 
which means that the fourth-grade students in this sample were directly representative 
of 89 percent of all the fourth-grade public school students in Montana. 

In Montana, 2,501 public school fourth-grade students were assessed in 1994. 

The weighted student participation rate was 96 percent for public schools. This means 
that the sample of fourth-grade students who took part in the assessment was directly 
representative of 96 percent of the eligible public school student population in 
participating schools in Montana (that is, all students from the population represented 
by the participating schools, minus those students excluded from the assessment). 

The overall weighted response rate (school rate times student rate) was 85 percent 
for public schools. This means that the sample of students who participated in the 
assessment was directly representative of 85 percent of the eligible fourth-grade public 
school population in Montana. 

Following standard practice in survey research, the results presented in this report 
were produced using calculations which incorporate adjustments for the nonparticipating 
schools and students. Hence, the final results derived from the sample provide estimates 
of the reading proficiency and achievement for the full population of eligible public 
school fourth-grade students in Montana. However, these nonparticipation adjustments 
may not adequately compensate for the missing sample schools and students in instances 
where nonparticipation rates are large. 

In order to guard against potential nonparticipation bias in published results, NCES 
has established minimum participation levels necessary for the publication of 1994 Trial 
State Assessment results. NCES also established additional guidelines that address four 
ways in which nonparticipation bias could be introduced into a jurisdiction’s published 
results (see Appendix A). In 1994, Montana failed to meet minimum participation rate 
guidelines for non-public schools. Hence, only public school results are included in this 
report. Montana met all established NCES participation rate guidelines for public 
schools. 
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Students’ Reading Performance 

The table below shows the distribution of reading proficiency of fourth-grade 
students attending public schools in Montana, the West region, and the nation. 

1994, Public School Students 

The average reading proficiency of fourth-grade public school students 
in Montana on the NAEP reading scale was 222. This average was 
higher than that of students across the nation (21 2). 3 The lowest 
performing 10 percent of public school fourth graders in Montana had 
proficiencies at or below 178 while the top 10 percent had proficiencies 
at or above 263. In public schools across the nation, the lowest 
performing 10 percent of fourth graders had proficiencies at or below 
156; the top performing 10 percent of students had proficiencies at or 
above 261. 
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1994 

Montana 

West 

Nation 



Distribution of Reading Proficiency for Fourth-Grade 
Public School Students 



Average 


10th 


25th 


50th 


75th 


90th 


Proficiency 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 




The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 



Performance According to Purpose for Reading 

The 1994 Trial State Assessment Program considered students’ performance in 
situations that involved reading different kinds of materials for different purposes. The 
fourth-grade reading assessment measured two global purposes for reading — reading 
for literary experience and reading to gain information. The table on the following 
page provides results for Montana, the West region, and the nation according to each 
reading purpose. 
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3 Differences reported as significant are statistically different at the 95 percent confidence level. This means that with 
95 percent confidence there is a real difference in the average reading proficiency between the two populations of 
interest. 
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1994, Public School Students 

The proficiency of public school students in Montana in reading for 
literary experience (225) was higher than that of students across the 
nation (214). Similarly, in reading to gain information, the proficiency 
of public school students in Montana (220) was higher than that of 
students across the nation (210). 
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Distribution of Reading Proficiency for Fourth-Grade 
Public School Students According to Purpose for 
Reading 
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The NAEP “purpose for reading” scales range from 0 to 500. The standard errors of the statistics appear in parentheses. 
It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). 



Levels of Reading Achievement 

The most recent reauthorization of the National Assessment Governing Board 
(NAGB) continues the Board’s responsibilities to set policy for NAEP and to “develop 
appropriate student achievement levels for each age and grade in subject areas tested” 
(Pub. L. 103-382). 

NAGB developed three achievement levels for each grade — Basic, Proficient, 
and Advanced. Performance at the Basic level denotes partial mastery of the knowledge 
and skills that are fundamental for proficient work at each grade level. The central level, 
called Proficient, represents solid academic performance at each grade level tested. 
Students reaching this level demonstrate competency over challenging subject matter and 
are well prepared for the next level of schooling. Performance at the Advanced level 
signifies superior performance at the grade tested. Definitions of the three levels of 
reading achievement are given on the following page. Chapter 3 provides further 
elaboration of these levels and presents examples of types of questions that students at 
each of the three achievement levels can respond to effectively. 
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Description of Fourth-Grade Reading Achievement 
Levels 



1994 Trial State Assessment 



Achievement 

Level 


Scale 

Cutpoint 


Description 


ADVANCED 

1 ;i|| 


268 


Fourth-grade students performing at the Advanced level 
should be able to generalize about topics in the reading 
selection and demonstrate an awareness of how authors 
compose and use literary devices. When reading text 
appropriate to fourth grade, they should be able to judge 
texts critically and, in general, give thorough answers that 
indicate careful thought. 


. > li: >, • V : 

■■■ ; ; ^ ; .. 

' , 'V' : 

PROFICIENT 

; >: r ^ ■ ■■ : " 


238 


Fourth -grade students performing at the Proficient level 
should be able to demonstrate an overall understanding 
of the text, providing inferential as well as literal 
information. When reading text appropriate to fourth grade, 
they should be able to extend the ideas in the text by 
making inferences, drawing conclusions, and making 
connections to their own experiences. The connection 
between the text and what the student infers should be 
clear. 


BASIC 


208 


Fourth-grade students performing at the Basic level should 
demonstrate an understanding of the overall meaning of 
what they read. When reading texts appropriate for fourth 
graders, they should be able to make relatively obvious 
connections between the text and their own experiences. 
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The table below provides the percentage of fourth-grade students at or above each 
achievement level, as well as the percentage of students below the Basic level. 

1994, Public School Students 

The percentage of public school students in Montana who were at or 
above the Proficient level (35 percent) was higher than that of students 
across the nation (28 percent). 
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1994 Public 

Montana 

West 

Nation 



Levels of Fourth-Grade Public School Students’ 
Reading Achievement 



At or Above 


At or Above 


At or Above 


Below 


Advanced 


Proficient 


Basic 


Basic 



Percentage 





_S9M.1> 41, (1.1) y 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 



Subpopulation Performance 

Assessment results repeatedly show differences in performance for subpopulations 
of students. 4 The 1994 Trial State Assessment provides additional information about 
the performance of important subpopulations by reporting on the reading proficiencies 
of various subgroups of the public school student population defined by race/ethnicity, 
type of location, parents’ education level, and gender. These results are summarized in 
the table on page 8. 




4 

Ina V.S. Mullis, John A. Dossey, Jay R. Campbell, Claudia A. Gentile, Christine O’Sullivan, and Andrew S. Latham. 
NAEP 1992 Trends in Academic Progress. (Washington, DC: National Center for Education Statistics, 1994). 
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Race/Ethnicity 

1994, Public School Students. The average reading proficiency of White 
students in Montana public schools was higher than that of Hispanic and 
American Indian students. 



Type of Location 

1994, Public School Students. The average reading proficiency of 
Montana students attending public schools in central cities was not 
significantly different from that of students in urban fringe/large towns 
and rural areas/small towns. 

Parents’ Education Level 

1994, Public School Students. Public school students in Montana 
reporting that at least one parent graduated from college demonstrated 
an average reading proficiency which did not differ significantly from 
that of students who reported that at least one parent had some education 
after high school but was higher than that of students who reported that 
at least one parent graduated from high school, neither parent graduated 
from high school, or they did not know their parents’ education level. 

Gender 

1994, Public School Students. In public schools in Montana, girls 
exhibited an average reading proficiency which was higher than that of 
boys. 
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Fourth-Grade Public School Students 9 Average 
Reading Proficiency by Subpopulation 



1994 Trial State Assessment 



1994 



RACE/ETHNICITY 

White 


Montana 

West 

Nation 


Hispanic 


Montana 

West 

Nation 


American Indian 


Montana 

West 

Nation 


TYPE OF LOCATION* 
Central City 


Montana 

Nation 


Urban Fringe/Large Town 


Montana 

Nation 


Rural/Small Town 


Montana 

Nation 


PARENTS’ EDUCATION 
College graduate 


Montana 

West 

Nation 


Some educ after HS 


Montana 

West 

Nation 


HS graduate 


Montana 

West 

Nation 


HS non-graduate 


Montana 

West 
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1 don’t know 


Montana 

West 
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GENDER 

Male 


Montana 

West 

Nation 


Female 


Montana 

West 

Nation 



Proficiency 
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* School sample size is insufficient to permit reliable regional results for type of location. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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A Context for Understanding Students 5 Reading Proficiency in Public Schools 

Information on the reading performance of students in Montana can be better 
understood and used for improving instruction and setting policy when supplemented 
with contextual information about schools, teachers, and students. 

To gather contextual information, the fourth-grade students participating in the 
1994 Trial State Assessment, their reading teachers, and the principals or other 
administrators in their schools were asked to complete questionnaires on policies, 
instruction, and programs. The student, teacher, and school data help to describe some 
of the current practices and emphases in reading education, illuminate some of the 
factors that appear to be related to fourth-grade public-school students’ reading 
proficiency, and provide an educational context for understanding information on student 
achievement. Highlights of the results for the public-school students in Montana are as 
follows: 

CURRICULUM COVERAGE AND INSTRUCTIONAL EMPHASIS 

• In Montana in 1994, average reading proficiency was similar for students 
regardless of how much time their reading teachers spent on reading 
instruction on a typical day. 

• According to the public school administrators in Montana, in 1994, 

60 percent of the fourth-grade students were in schools where reading 
was identified as receiving special emphasis. This percentage was 
smaller than that of students across the country (85 percent). 

• In 1994, according to their reading teachers, 17 percent of the students 
in public schools in Montana were typically taught reading in a class that 
was grouped by reading ability. The prevalence of ability grouping was 
not significantly different across the nation (22 percent). 



DELIVERY OF READING INSTRUCTION 

• Students in Montana whose teachers used both basal and trade books 
demonstrated an average reading proficiency (222) which did not differ 
significantly from that of students whose teachers primarily used basal 
readers (224). 

• The proficiency of Montana students whose teachers used both basal and 
trade books (222) was not significantly different from that of students 
whose teachers primarily used trade books (225). 

• The proficiency of Montana students whose teachers primarily used 
trade books (225) was not significantly different from that of students 
whose teachers primarily used basal readers (224). 
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• In Montana, 44 percent of the fourth-grade students had reading 
teachers who used children’s newspapers and/or magazines at least once 
a week; 15 percent of the students had reading teachers who used 
reading kits at least once a week; 1 8 percent had reading teachers who 
used computer software for reading instruction at least once a week; 
73 percent of the students had reading teachers who used a variety of 
books at least once a week; and, finally, 75 percent of the students had 
reading teachers who used materials from other subject areas at least 
once a week. 

• According to the Montana reading teachers, 59 percent of the students 
were asked to discuss new or difficult vocabulary almost every day. 
This percentage did not differ significantly from that of students across 
the nation (62 percent). 

• According to their reading teachers, the percentage of students in 
Montana who were asked to talk with each other almost every day about 
what they have read (39 percent) was not significantly different from 
that of students across the nation, where 34 percent of the students were 
asked to do this activity almost every day. 

• According to the reading teachers in Montana, 8 percent of the students 
were asked to do a group activity or project about what they have read 
almost every day. This figure was not significantly different from that 
of students across the nation (5 percent). 



EDUCATIONAL BACKGROUND OF TEACHERS 

• The percentage of students who were being taught by reading teachers 
who reported having at least a master’s or education specialist’s degree 
in Montana (28 percent) was smaller than that for the nation 
(41 percent). 

• About half of the students (49 percent) had reading teachers who had 
the highest level of teaching certification that is recognized by Montana. 
This was smaller than the figure for the nation, where 65 percent of the 
students were taught by reading teachers who were certified at the 
highest level available in their states. 

• In Montana, 24 percent of the students were being taught reading by 
teachers who had an undergraduate major in English, reading, and/or 
language arts. This was not significantly different from the percentage 
of students across the nation who were being taught by reading teachers 
with the same major (20 percent). 
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HOME FACTORS 

• In Montana, 36 percent of the students reported having four types of 
reading materials (a newspaper, an encyclopedia, 25 or more books, and 
magazines) in the home. This figure was not significantly different from 
that for the nation (36 percent). Students in Montana who had all four 
of these types of materials in the home showed an average reading 
proficiency (231) which was higher than that of students with zero to 
two types of materials (213). 

• In 1994 in Montana, 25 percent of the students discussed with friends 
or family what they read almost every day. This percentage was 
somewhat smaller than that of students across the nation (28 percent). 

The proficiency of students in Montana who discussed what they read 
with friends or family almost every day (223) was higher than that of 
students who had discussions with friends or family less than weekly 
(218). 

• Relatively few of the fourth-grade students (12 percent) watched six 
hours or more of television each day. This was smaller than the figure 
for the nation, where 22 percent of the students watched this much 
television. Average reading proficiency in Montana was lowest for 
students who spent six hours or more watching television each day. 

Comparisons of Overall Reading Proficiency in Montana with Other States 

The map on the following page provides a method for making appropriate 
comparisons of the overall public school reading proficiency in Montana with that in 
other states (including Guam and the Department of Defense Education Activity 
[DoDEA] Overseas Schools) that participated in the NAEP 1994 Trial State Assessment 
Program. The different shadings of the states on the map show whether the average 
overall proficiency of public school students in the other states was statistically different 
from or not statistically different from that of public school students in Montana (‘Target 
State”). States in black have a significantly lower average public school proficiency than 
does Montana. States with a dark-gray shading have a significantly higher average 
public school proficiency than does Montana. States with a light-gray shading have an 
average public school proficiency that does not differ significantly from that of Montana. 
The significance tests are based on a Bonferroni procedure for multiple comparisons that 
holds the probability of erroneously declaring the means of any two states to be different, 
when they are not, to no more than five percent. Two states — Idaho and Michigan 
— did not meet minimum school participation guidelines for public schools. Another 
jurisdiction — Washington, DC — withdrew from the Trial State Assessment after the 
data collection phase. Therefore, these three jurisdictions are not included in the 
comparisons depicted on the map on the following page. 
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OVERVIEW 



or over 25 years, the National Assessment of Educational Progress (NAEP) 
has been the nation’s primary indicator of student achievement, reporting on what 
students know and can do in various school subject areas at grades 4, 8, and 12. With 
legislation passed by Congress in 1988, NAEP’s mission of providing dependable and 
comprehensive information about educational progress in the United States was 
expanded to involve a voluntary state-by-state assessment on a trial basis. 

Consequently, the 1990 NAEP program included a Trial State Assessment 
Program in which public school students in 37 states, the District of Columbia, and two 
territories were assessed in eighth-grade mathematics. 5 Building on this initial effort, 
the 1992 NAEP program included a Trial State Assessment Program in fourth-grade 
reading and fourth- and eighth-grade mathematics, with public school students assessed 
in 41 states, the District of Columbia, and two territories. 6 

The continuation of NAEP’s Trial State Assessment Program in 1994 was 
authorized by additional legislation that enlarged the state-by-state assessment to include 
non-public school students: 

The National Assessment shall conduct in 1994 . . . a trial reading 
assessment for the 4th grade , in states that wish to participate , with the 
purpose of determining whether such assessments yield valid and 
reliable State representative data . (Section 406(i)(2)(C)(i) of the 

General Education Provisions Act, as amended by Pub. L. 103-33 
(U.S.C. 1221e-l(a)(2)(B)(iii))) 

The National Assessment shall include in each sample assessment . . . 
students in public and private schools in a manner that ensures 
comparability with the national sample. (Section 406(i)(2)(C)(i) of the 
General Education Provisions Act, as amended by Pub. L. 103-33 
(U.S.C. 1221e-l(a)(2)(B)(iii))) 



5 For a summary of the 1990 program, see Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. 
The State of Mathematics Achievement: NAEP’s 1990 Assessment of the Nation and the Trial Assessment of the States. 
(Washington, DC: National Center for Education Statistics, 1991). 

6 For a summary of the 1992 assessment of reading, see Ina V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The 
NAEP 1992 Reading Report Card for the Nation and the States. (Washington, DC: National Center for Education 
Statistics, 1993). For a summary of the 1992 assessment of mathematics, see Ina V.S. Mullis, John A. Dossey, Eugene 
H. Owen, and Gary W. Phillips. NAEP 1992 Mathematics Report Card for the Nation and the States. (Washington, 
DC: National Center for Education Statistics, 1993). 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



23 



15 



Montana 



In addition to the state assessment program in reading at grade 4, the 1994 NAEP 
involved national assessments of reading, geography, and history at grades 4, 8, and 12. 

The 1994 Trial State Assessment Program was conducted in February 1994 with 
the following 44 participants: 
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Jurisdictions in italics — Montana, Washington, and the Department of Defense 
Education Activity (DoDEA) Overseas Schools — did not participate in the 1992 Trial 
State Assessment Program. Two states — Idaho and Michigan — did not meet minimum 
school participation guidelines for public schools. Another jurisdiction — Washington, 
DC — withdrew from the Trial State Assessment Program after the data collection 
phase. Therefore, public school results for these three jurisdictions are not reported. 
Three jurisdictions — Ohio, Oklahoma, and the Virgin Islands — participated in the 
1992 Trial State Assessment but not in the 1994 program. 

For the 1994 Trial State Assessment in reading, a combined sample of 
approximately 2,800 public and non-public school students was assessed in most 
jurisdictions. The samples were carefully designed to represent the fourth-grade 
populations in the states or jurisdictions. Participating jurisdictions were responsible for 
the administration of the assessment. For jurisdictions that participated in the 1992 Trial 
State Assessment Program, contractor staff monitored 25 percent of public school 
sessions and 50 percent of non-public school sessions. For jurisdictions that did not 
participate in 1992, contractor staff monitored 50 percent of both public and non-public 
school sessions. Monitoring efforts were part of a quality assurance program designed 
to ensure that sessions were conducted uniformly. 

The 1992 Trial State and National Assessment programs in reading were based 
on a framework developed through a national consensus process that was set forth by 
law and called for “active participation of teachers, curriculum specialists, subject matter 
specialists, local school administrators, parents, and members of the general public” 
(Pub. L. 100-297, Part C, 1988). 7 This same framework served as the basis of the 1994 
Trial State and National Assessment programs. 

7 NAEP Reading Consensus Project. Reading Framework for the 1992 and 1994 National Assessment of Educational 
Progress. (Washington, DC: National Assessment Governing Board, U.S. Department of Education, 1994). 
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The process of developing the framework was carried out in late 1989 and early 
1990 by the Council of Chief State School Officers (CCSSO) under contract from the 
National Assessment Governing Board (NAGB) which is responsible for formulating 
policy for NAEP, including developing assessment objectives and test specifications. 
The framework development process included gathering input from a wide range of 
people in the fields of reading and assessment, such as school teachers, administrators, 
and state coordinators of reading and reading assessment. After thorough discussion and 
some amendment, the framework was adopted by NAGB in March 1 990. An overview 
of the reading framework is provided in Appendix A. 

The 1994 fourth-grade Trial State and National Assessments in reading consisted 
of eight sections or blocks, each 25 minutes in length. All fourth-grade students in the 
assessment were required to complete two blocks. Each block contained a passage or 
set of passages and a combination of constructed-response and multiple-choice 
questions. Passages selected for the assessment were drawn from authentic texts used 
by students in typical reading situations. Complete stories, articles, or sections of 
textbooks were used, rather than excerpts or abridgements. The type of question — 
constructed-response or multiple-choice — was determined by the objective being 
measured. In addition, the constructed-response questions were of two types: short 
constructed-response questions which required students to respond to a question in a few 
words or a few sentences and extended constructed-response questions which required 
students to respond to a question in a paragraph or more. 



This Report 

This is a computer-generated report that describes the reading performance of 
fourth-grade public school students in Montana, in the West region, and across the 
nation. A separate report describes additional fourth-grade reading assessment results 
for the nation and the states, as well as the national results for grades 8 and 1 2. 8 This 
report consists of four sections: 

• This Overview provides background information about the 1994 Trial 
State Assessment Program and a profile of the fourth-grade students in 
Montana. 

• Part One shows the distribution of reading proficiency results for 
fourth-grade public school students in Montana, the West region, and the 
nation. 

• Part Two presents reading achievement level results for public school 
fourth graders in Montana, the West region, and the nation. 

• Part Three relates fourth-grade public school students’ reading 
proficiency to contextual information about the reading policies, 
instruction, and home support for reading in Montana, the West region, 
and the nation. 



g 

See NAEP 1994 Reading Report Card for the Nation and the States. (Washington, DC: National Center for Education 
Statistics, 1995). 




THE 1994 NAEP TRIAL STATE ASSESSMENT 



17 



Montana 



In this report, results are provided for groups of students defined by shared 
characteristics — race/ethnicity, type of location, parents’ education level, and gender. 
Based on criteria described in Appendix A, data are reported for subpopulations only 
where sufficient numbers of students and adequate school representation are present. 
For public school students, there must be at least 62 students in a particular subgroup 
from at least 10 different schools. However, the data for all students, regardless of 
whether their subgroup was reported separately, were included in computing overall 
results for Montana. Definitions of the subpopulations referred to in this report are 
presented below. 

The results for Montana are based on the representative sample of students who 
participated in the 1994 Trial State Assessment Program. The results for the nation and 
the region of the country are based on the nationally and regionally representative 
samples of students who were assessed in January through March as part of the national 
NAEP program. Using the national and regional results from the 1994 national NAEP 
program is necessary because of the voluntary nature of the Trial State Assessment 
Program. Since not every state participated in the program, the aggregated data across 
states did not necessarily provide representative national or regional results. Specific 
details on the samples and analysis procedures used can be found in the Technical Report 
of the 1994 NAEP Trial State Assessment Program in Reading. 9 

Race/Ethnicitv 

Results are presented for students of different racial/ethnic groups based on the 
students’ self-identification of their race/ethnicity according to the following mutually 
exclusive categories: White, Black, Hispanic, Asian, Pacific Islander, and American 
Indian (including Alaskan Native). 

Type of Location 

Results are provided for students attending public schools in three mutually 
exclusive location types — central city, urban fringe/large town, and rural/small town 
— as defined below. The type of location variable is defined in such a way as to indicate 
the geographical location of a student’s school. The intention is not to indicate, or 
imply, social or economic meanings for these location types. The type of location 
variable, given the current NAEP sampling, does not support the reporting of regional 
results. Therefore, only state and national results will be presented. 

Central City: The Central City category includes central cities of all 
Standard Metropolitan Statistical Areas (SMSA’s). 10 Central City is a 
geographic term and is not synonymous with “inner city.” 



9 ^ ^ 

Technical Report of the NAEP 1994 Trial State Assessment Program in Reading. (Washington, DC: National Center 
for Education Statistics, 1995). 

10 

Standard Metropolitan Statistical Area (SMSA) as defined by the Office of Management and Budget. 
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Urban Fringe/Large Town: An Urban Fringe includes all densely 

settled places and areas within SMSA’s that are classified as urban by 
the Bureau of the Census. A Large Town is defined as places outside 
SMSA’s with a population greater than or equal to 25,000. 

Rural/Small Town: Rural includes all places and areas with a 

population of less than 2,500 that are classified as rural by the Bureau 
of the Census. A Small Town is defined as places outside SMSA’s 
with a population of less than 25,000 but greater than or equal to 2,500. 

Parents’ Education Level 

Students were asked to indicate the extent of schooling for each of their parents 
— did not finish high school, graduated from high school, had some education after high 
school, graduated from college, or did not know. The response indicating the higher 
level of education was selected for reporting. Note that a substantial percentage of 
fourth-grade students did not know their parents’ education level. 

Gender 

Results are reported separately for males and females. 

Region 

The United States has been divided into four regions for purposes of this report: 
Northeast, Southeast, Central, and West. States included in each region are shown in 
Figure O.l. All 50 states and the District of Columbia are listed, with the participants 
in the 1994 Trial State Assessment Program highlighted in boldface type. Guam and 
the Department of Defense Education Activity (DoDEA) Overseas Schools were not 
assigned to a region. Further, students attending public schools in the part of Virginia 
that is included in the Washington, DC, metropolitan statistical area are included in the 
Northeast regional results; students attending public schools in the remainder of the state 
are included in the Southeast regional results. Because most of the Virginia students 
are in the Southeast region, regional comparisons for Virginia are to the Southeast. 

Regional results are based on national assessment samples, not on aggregated Trial 
State Assessment samples, as explained on the previous page. Thus, the regional results 
are based on a different and separate sample from that used to report the state results. 
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FIGURE 0.1 
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Note: Part of Virginia (near metropolitan Washington, DC) is included in the Northeast region, and the rest of Virginia 
is in the Southeast region. 



Guidelines for Analysis and Reporting 

This report describes reading performance for public school fourth graders and 
compares the results for various groups of students within that population — for 
example, those who have certain demographic characteristics or who responded to a 
specific background question in a particular way. The report examines the results for 
individual demographic groups and individual background questions. It does not include 
an analysis of the relationships among combinations of these subpopulations or 
background questions. 

Because the percentages of students in these subpopulations and their average 
proficiencies are based on samples — rather than on the entire population of fourth 
graders in a jurisdiction — the numbers reported are necessarily estimates . As such, they 
are subject to a measure of uncertainty, reflected in the standard error of the estimate. 
When the percentages or average proficiencies of certain groups are compared, it is 
essential to take the standard error into account, rather than to rely solely on observed 
similarities or differences. Therefore, the comparisons discussed in this report are based 
on statistical tests that consider both the magnitude of the difference between the means 
or percentages and the standard errors of those statistics. 
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The statistical tests determine whether the evidence — based on the data from the 
groups in the sample — is strong enough to conclude that the means or percentages are 
really different for those groups in the population. If the evidence is strong (i.e., the 
difference is statistically significant), the report describes the group means or 
percentages as being different (e.g., one group performed higher than or lower than 
another group) — regardless of whether the sample means or sample percentages appear 
to be about the same or not. If the evidence is not sufficiently strong (i.e., the difference 
is not statistically significant), the means or percentages are described as being not 
significantly different — again, regardless of whether the sample means or sample 
percentages appear to be about the same or widely discrepant. The reader is cautioned 
to rely on the results of the statistical tests — rather than on the apparent magnitude of 
the difference between sample means or percentages — to determine whether those 
sample differences are likely to represent actual differences between the groups in the 
population. The statistical tests and Bonferroni procedure, which is used when more 
than two groups are being compared, are discussed in greater detail in Appendix A. 

In addition, some of the percentages reported in the text of the report are given 
quantitative descriptions (e.g., relatively few, about half, almost all, etc.). The 
descriptive phrases used and the rules used to select them are also described in 
Appendix A. 

Finally, in several places in this report, results (mean proficiencies and 
percentages) are reported in the text for combined groups of students. For example, in 
the text, the proficiency of students in the combined group who reported reading for fun 
once or twice a month or never or hardly ever is given and compared to the group who 
reported reading for fun almost every day. However, the table that accompanies that text 
reports percentages and proficiencies separately for the four groups (almost every day, 
once or twice a week, once or twice a month, and never or hardly ever). The combined 
group proficiencies reported in the text and used in all statistical tests are based on 
unrounded estimates (i.e., estimates calculated to several decimal places) of the 
proficiencies for each group. The percentages shown in the tables are rounded to 
integers. Thus, percentages may not always add up to 100 percent due to rounding. 
Also, the percentage for a combined group (reported in the text) may differ slightly from 
the sum of the separate percentages (presented in the tables) for each of the groups that 
were combined. Therefore, if statistical tests were to be conducted based on the rounded 
numbers in the tables, the results might not be consonant with the results of the statistical 
tests that are reported in the text (based on unrounded numbers). 
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Profile of Montana 

Fourth-Grade School and Student Characteristics 

Table 0.1 provides a profile of the demographic characteristics of the fourth-grade 
public school students in Montana, the West region, and the nation. This profile is based 
on data collected from the students and schools participating in the 1994 Trial State and 
National Assessments. As described earlier, the state data and the regional and national 
data are drawn from separate samples. 

Schools and Students Assessed 

Table 0.2 summarizes participation data for schools and students sampled in 
Montana for the 1994 Trial State Assessment. 1 1 In Montana, 111 public schools 

participated in the 1994 fourth-grade reading assessment. This number includes 
participating substitute schools that were selected to replace some of the nonparticipating 
schools from the original sample. The weighted school participation rate after 
substitution in 1994 was 89 percent for public schools, which means that the 
fourth-grade students in this sample were directly representative of 89 percent of all the 
fourth-grade public school students in Montana. 

In each school, a random sample of students was selected to participate in the 
assessment. In 1994, as estimated by the sample, 1 percent of the fourth-grade public 
school population were classified as Limited English Proficient (LEP), while 1 1 percent 
in public schools had an Individualized Education Plan (IEP). An IEP is a plan, written 
for a student who has been determined to be eligible for special education, that typically 
sets forth goals and objectives for the student and describes a program of activities 
and/or related services necessary to achieve the goals and objectives. Students with 
disabilities may be categorized as IEP. 

Schools were permitted to exclude certain students from the assessment, provided 
that certain criteria were met. To be excluded, a student had to be categorized as 
Limited English Proficient or had to have an Individualized Education Plan and (in 
either case) be judged incapable of participating in the assessment. The intent was to 
assess all selected students; therefore, all selected students who were capable of 
participating in the assessment should have been assessed. However, schools were 
allowed to exclude those students who, in the judgment of school staff, could not 
meaningfully participate. The NAEP guidelines for exclusion are intended to assure 
uniformity of exclusion criteria from school to school. Note that some LEP and IEP 
students were deemed eligible to participate and not excluded from the assessment. The 
students in Montana who were excluded from the assessment because they were 
categorized as LEP or had an IEP represented 3 percent of the public school population 
in grade 4. 



For a detailed discussion of the NCES guidelines for sample participation, see School and Student Participation Rates 
for the Reading Assessment and Guidelines for Participation. (Washington, DC: National Center for Education 
Statistics, 1994); or see Appendix B of the Technical Report of the NAEP 1994 Trial State Assessment Program in 
Reading. (Washington, DC: National Center for Education Statistics, 1995). 
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TABLE 0.1 

Profile of Fourth-Grade Public School Students in 
Montana, the West Region, and the Nation 

1994 



Demographic Subgroups 



RACE/ETHNICfTY 
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Hispanic 
Asian 

Pacific Islander 
American Indian 
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Black 
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Asian 

Pacific Islander 
American Indian 

Nation White 

Black 
Hispanic 
Asian 

Pacific Islander 
American Indian 

TYPE OF LOCATION * 

Montana Central City 

Urban Fringe/Large Town 
Rural/Small Town 

Nation Central City 

Urban Fringe/Large Town 
Rural/Small Town 



PARENTS’ EDUCATION 

Montana Graduated college 

Some education after high school 
Graduated high school 
Did not finish high school 
I don't know 

West Graduated college 

Some education after high school 
Graduated high school 
Did not finish high school 
I don't know 

Nation Graduated college 

Some education after high school 
Graduated high school 
Did not finish high school 
I don't know 
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* School sample size is insufficient to permit reliable regional results for type of location. 

The stan dar d errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). The percentages 
for Race/Ethnicity may not add to 100 percent because some students categorized themselves as “Other” 
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In Montana, 2,501 public school fourth-grade students were assessed in 1994. 

The weighted student participation rate was 96 percent for public schools. This means 
that the sample of fourth-grade students who took part in the assessment was directly 
representative of 96 percent of the eligible public school student population in 
participating schools in Montana (that is, all students from the population represented 
by the participating schools, minus those students excluded from the assessment). 

The overall weighted response rate (school rate times student rate) was 85 percent 
for public schools. This means that the sample of students who participated in the 
assessment was directly representative of 85 percent of the eligible fourth-grade public 
school population in Montana. 

Following standard practice in survey research, the results presented in this report 
were produced using calculations which incorporate adjustments for the nonparticipating 
schools and students. Hence, the final results derived from the sample provide estimates 
of the reading proficiency and achievement for the full population of eligible public 
school fourth-grade students in Montana. However, these nonparticipation adjustments 
may not adequately compensate for the missing sample schools and students in instances 
where nonparticipation rates are large. 

In order to guard against potential nonparticipation bias in published results, NCES 
has established minimum participation levels necessary for the publication of 1994 Trial 
State Assessment results. NCES also established additional guidelines that address four 
ways in which nonparticipation bias could be introduced into a jurisdiction’s published 
results (see Appendix A). In 1994, Montana failed to meet minimum participation rate 
guidelines for non-public schools. Hence, only public school results are included in this 
report. Montana met all established NCES participation rate guidelines for public 
schools. 

In the analysis of student data and reporting of results, nonresponse weighting 
adjustments have been made at both the school and student level, with the aim of making 
the sample of participating students as representative as possible of the entire eligible 
fourth-grade public school population. For details of the nonresponse weighting 
adjustment procedures, see the Technical Report of the NAEP 1994 Trial State 
Assessment Program in Reading. 
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TABLE 0.2 

Profile of the Fourth-Grade Population Assessed in 
Montana 



1994 Trial State Assessment 



Public 



1994 

Non-Public 



SCHOOL PARTICIPATION 

Weighted school participation rate before substitution 

Weighted school participation rate after substitution 

Number of schools originally sampled 

Number of schools not eligible 

Number of schools in original sample participating 

Number of substitute schools provided 

Number of substitute schools participating 

Total number of participating schools 

STUDENT PARTICIPATION 

Weighted student participation rate after makeups 

Number of students selected to participate in the 
assessment 

Number of students withdrawn from the assessment 

Percentage of students who were of Limited English 
Proficiency 

Percentage of students excluded from the assessment 
due to Limited English Proficiency 

Percentage of students who had an Individualized 
Education Plan 

Percentage of students excluded from the assessment 
due to Individualized Education Plan Status 

Number of students to be assessed 

Number of students assessed 

Overall weighted response rate 
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PART ONE 



The Reading Proficiency of Fourth-Grade 
Public School Students in Montana 

I^eading involves the interaction between and among a reader, a text, and a 
situation. 12 Thus, students’ reading comprehension is influenced by the type of material 
read and the specific purposes for reading. The 1994 Trial State Assessment Program 
considered students’ proficiency in situations that involved reading different kinds of 
materials for different purposes. The fourth-grade reading assessment measured two 
global purposes for reading — reading for literary experience and reading to gain 
information . 13 Students’ proficiency on each of the two purposes for reading was 
summarized on separate NAEP reading scales (one for each purpose), which range from 
0 to 500. In addition, results for an overall reading scale reflecting average proficiency 
across the two purposes for reading are also presented. The overall reading scale also 
ranges from 0 to 500. 

This part of the report contains two chapters that describe the reading proficiency 
of fourth-grade students in Montana. Chapter 1 compares the overall reading proficiency 
of public school students in Montana to the West region and the nation. It also presents 
the students’ average proficiency for the two purposes for reading. Chapter 2 
summarizes reading proficiency for subpopulations of public school students defined by 
race/ethnicity, type of location, parents’ education level, and gender. 



12 J.A. Dole, G.G. Duffy, L.R. Roehler, and P.D. Pearson. “Moving from the Old to the New: Research on Reading 
Comprehension Instruction,” in Review of Educational Research , 61. (1991). pp. 239-264. 

13 The eighth- and twelfth-grade national NAEP reading assessments also measured a third purpose for reading — reading 
to perform a task. 
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CHAPTER 1 



Students’ Reading Proficiency 

In 1 994, renewed emphasis was placed on national education goals when Congress 
reauthorized the Elementary and Secondary Education Act (ESEA) and enacted the Goals 
2000: Educate America Act. A concern for higher academic standards is evident in the 
ESEA’s efforts to provide programs to improve America’s schools. Goals 2000 reasserts 
the importance of establishing and meeting rigorous goals in the education of our 
nation’s students — All students will leave grades 4, 8, and 12 having demonstrated 
competency over challenging subject matter including English, mathematics, science, 
foreign languages, civics and government, economics, arts, history, and geography, and 
every school in America will ensure that all students leam to use their minds well, so they 
may be prepared for responsible citizenship, further learning, and productive employment 
in our nation’s modem economy. Reading ability can be viewed as an enabling skill for 
reaching these goals. Therefore, concern about attaining these goals and, more 
specifically, about the reading abilities of our nation’s students has increased because 
recent NAEP results appear to indicate that many students of all ages have difficulty 
reading thoughtfully. 14 

The NAEP Reading Framework underlying both the 1992 and 1994 assessments 
views reading as a dynamic, complex interaction between and among the reader, the text, 
and the context of the reading experience. Readers, for example, bring to the reading 
process their prior knowledge about a topic, their reasons for reading, their individual 
reading skills and strategies, and their understanding of differences in text structures. 15 

The texts used in the NAEP reading assessment are representative of common 
reading demands. Because reading performance varies in response to texts and contexts, 
the NAEP assessment measured students’ abilities to read different types of materials 
for different purposes. The texts were selected from naturally-occurring sources that are 
typically available to children in and out of school. Students in grade 4 were asked to 
respond to literary and informational texts, corresponding with the two purposes for 
reading assessed at grade 4 — reading for literary experience and reading to gain 
information. 
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14 Ina V.S. Mullis, Jay R. Campbell, and Alan E. Farstmp. The NAEP 1992 Reading Report Card for the Nation and the 
States . (Washington, DC: National Center for Education Statistics, 1993); lna V.S. Mullis, John A. Dossey, Jay R. 
Campbell, Claudia A. Gentile, Christine O’Sullivan, and Andrew S. Latham. NAEP 1992 Trends in Academic 
Progress. (Washington, DC: National Center for Education Statistics, 1994). 

15 J.A. Langer. “The Process of Understanding: Reading for Literary and Informational Purposes,” in Research in the 
Teaching of English, 24. (1990). pp. 229-260; NAEP Reading Consensus Project Reading Framework for the 1992 
and 1994 National Assessment of Educational Progress. (Washington, DC: National Assessment Governing Board, 
U.S. Department of Education, 1994). 
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Reading for literary experience typically involves the reader in vicarious 
experiences through the story’s characters or considerations of how the author explores 
human events. Literary texts include short stories, poems, and folktales that engage the 
reader in a variety of ways, not the least of which is reading for fun. Reading to gain 
information may involve seeking to learn about a topic or to search for specific 
information. Informational texts include selections from textbooks, magazines, 
encyclopedias, and other written sources whose purpose is to increase the reader’s 
knowledge. Differences between narrative and informational text typically require 
students to use different skills and strategies. 

In addition to having fourth graders demonstrate their ability to read for two 
different purposes, the assessment asked students to build, extend, and examine meaning 
from four stances or types of interactions with the text. 



Students are asked to extend the ideas in the text by making inferences 
and connections. This includes making connections between cause and 
effect, analyzing the motives of characters, and drawing conclusions. 

Personal Response 

Students are asked to make explicit connections between the ideas in the 
text and their own background knowledge and experiences. This 
includes comparing story characters with themselves or people they 
know, or indicating whether they found a passage useful or interesting. 



Students are asked to consider the text objectively. This includes 
identifying how the author crafted a text with stylistic devices such as 
mood and tone. 

These stances are not considered hierarchical or completely independent of each 
other. Rather, they are viewed as recursive processes that take place throughout reading 
and represent different dimensions of the reader’s understanding. They provide a frame 
for generating assessment questions and considering student performance at all levels. 
All students at all levels should be able to respond to reading selections from all of these 
stances. What varies with students’ developmental and proficiency levels is the amount 
of prompting or support needed to elicit their responses, the complexity of the texts to 
which they can respond, and the sophistication of their answers. 

This chapter describes the reading proficiency of Montana’s public school fourth 
graders in 1994 and the comparative results of their regional and national counterparts. 



Initial Understanding 



Students are asked to provide the overall or general meaning of the 
selection. This includes first impressions, main points, or themes. 



Developing an Interpretation 



Critical Stance 
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Table 1.1 shows the distribution of reading proficiency of fourth-grade students 
attending public schools in Montana, the West region, and the nation. 

1994 y Public School Students 

The average reading proficiency of fourth-grade public school students 
in Montana on the NAEP reading scale was 222. This average was 
higher than that of students across the nation (21 2). 16 The lowest 
performing 10 percent of public school fourth graders in Montana had 
proficiencies at or below 178 while the top 10 percent had proficiencies 
at or above 263. In public schools across the nation, the lowest 
performing 10 percent of fourth graders had proficiencies at or below 
156; the top performing 10 percent of students had proficiencies at or 
above 261. 
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TABLE 1.1 



Distribution of Reading Proficiency for Fourth-Grade 
Public School Students 



Average 


10th 


25th 


50th 


75th 


90th 


Proficiency 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



( i.9) 






. 185 ( 3.0) 



225 ( 1 . 4 ) 

itlSSifia)' 






. . 263 (: 1.1); 

§242 '($&) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 
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16 Differences reported as significant are statistically different at the 95 percent confidence level. This means that with 
95 percent confidence there is a real difference in the average reading proficiency between the two populations of 
interest. 
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Proficiency According to Purpose for Reading 

As previously indicated, the questions in the 1994 Trial State Assessment Program 
covered two purposes for reading at grade 4 — reading for literary experience and 
reading to gain information. Table 1.2 provides results for Montana, the West region, 
and the nation according to each reading purpose. 

1994, Public School Students 

The proficiency of public school students in Montana in reading for 
literary experience (225) was higher than that of students across the 
nation (214). Similarly, in reading to gain information, the proficiency 
of public school students in Montana (220) was higher than that of 
students across the nation (210). 



THE N ATION'S 

waefjl 

m 

1994 Trial State Assessment 









"jr 


Reading for Literary Experience 


; yV : : ' \f, \ \ ; : .* '"xK' : ‘"l-:! : -i > : • ;• 






1994 Public 


. - 


lit v ' . - 


, 


Montana 


?22Si(Jii6)j PR'W 


203 ( 2.3) : 228 ( 1.5) 249 ( 1 .4) ; 


267 1 12) 


West 








Nation 


214 (4.2) | : i57(2^) 


189 (1.6) 219 ( £l)J;:C;a4^^12)ll 


264 (1.3) 


Reading to Gain Information 


: 


lllliiil® SllSlft ■ 81BI IBS 1: ilBliB 1 :: i 1 : |f| ; 




1994 Public 


- 


* 


. ■ V-V. - :■ '^V 


Montana 


220(1.4) ;il74' 


'IHsa v - 222 ( M&X 


263 ( 1.6) 


West 


210 { 22 .) ;^50;(.4:7)i 


Sigi83 


263 (2:3) 


Nation 


210 (15) : 151 (2.0) 


183( 1.4) 214( 1.5)- 240 ( 1.5) 


262 ( 1.4) 



The NAEP “purpose for reading” scales range from 0 to 500. The standard errors of the statistics appear in parentheses. 
It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). 
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TABLE 1.2 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students According to Purpose for 
Reading 



Average 


10th 


25th 


50th 


75th 


90th 


Proficiency 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 
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CHAPTER 2 



Reading Proficiency of Fourth-Grade 
Students by Subpopulations 



The overall reading proficiency of public school students across the country 
presented in the previous chapter provides a global view of the state of reading 
performance. However, it is also important to look more closely at the performance of 
subgroups and to consider how different groups of children are progressing in reading. 
This information can provide educators, policy makers, and concerned citizens with 
important knowledge about how well students from different backgrounds and with 
different experiences are developing as readers. 

The 1994 Trial State Assessment Program provides additional information about 
the reading proficiency of important subpopulations by reporting on the performance of 
various subgroups of the public school student population defined by race/ethnicity, type 
of location, parents’ education level, and gender. 



The 1994 Trial State Assessment Program results for different racial/ethnic groups 
can be compared when the number of schools and students in a racial/ethnic group is 
of sufficient size to be reliably reported. (See Appendix A for details.) Table 2.1 
presents reading proficiency results for White, Hispanic, and American Indian 
fourth-grade public school students from Montana. 

1994, Public School Students 

As shown in Table 2.1, the average reading proficiency of White 
students in Montana public schools was higher than that of Hispanic and 
American Indian students. 



Race/Ethnicity 
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TABLE 2.1 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Race/Ethnicity 



1994 Trial State Assessment 


Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 




White 








• : MMA 






1994 Montana 


226(1.3) 




§206 ( 2.0) 




> ’^249 ( 1,4) * 


liaee® m$m 


West 


222 (<2.0). : 


170(4.6) 




^226{a0) 






Nation 




175(2.3) 


- 201 ( 1.7) ; 


#32&i T.4)‘ - 




266 ( 2,4) || 


Hispanic 








V ;; | *• 






1994 Montana 


208 ( 32) ; 


162(57) 


188 (52) 


?:>212(,3.9)^ : ' 


i|2®p3.0) • 


|p48l|SS^| 


West 


il86;^4p* 


1^129 




ililiisa) 


v: 215 ( 3.0) : 




Nation 


188 < 2.7) . 


•f 134 (4.7) ^ 


vj 160 ( ZS)^ J 




V:217;('3.5) 


242 ( 3.6) 


American Indian 








. If ; V :i Av": 






1 994 Montana 


203 (2.8) : 


155 (102) ' 


182 (7,1) 


206 { 4.0) 


228 ( 4.3) 


247(3.9) | 


West 


ttS&Wi $\ 




Itilr r?) :/, 






' *** 


Nation 


. 200 ( '3.6) 


145 ( 5.6) ; 


174 (82) 


205(2.6) 


.230(52) 


0pi4s0; ■ 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). *** Sample size is insufficient to permit a reliable estimate. 
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Type of Location 

Table 2.2 presents the reading proficiency results for fourth-grade students 
attending public schools in central cities, urban fringe/large towns, and rural areas/small 
towns. 



1994 , Public School Students 

The results indicate that the average reading proficiency of Montana 
students attending public schools in central cities was not significantly 
different from that of students in urban fringe/large towns and rural 
areas/small towns. 
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TABLE 2.2 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Type of Location 



1994 Trial State Assessment 


Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 


Central City 
1994 Montana 
Nation 

Urban Fringe/Large Town 
1994 Montana 
Nation 

Rural/Small Town 
1994 Montana 
Nation 


218 ( 3.1) 174 ( 8.3) 197 ( 4.8) 221 f| 35) 242 ( 2.4) 259 ( 2.5} 

203 (2.4) , 4 44£ £2.6) % 208 ( 3.0) 235 ( 2.7) 256 ( 2.0) 

224 ( 4.2) 182 ( 3.3) 204 ( 3.3) 226 ( 4.3) 246 ( 4.3) 264 ( 8.1) 

.»9>('l-.9) .si 66 (4.4) 196(3.0) .(-223 (4.1), (S 1246 (1,7) ^'1265 ( 3.0) 

223(1.7) 178 { 2.1) 202 ( 22 ) 227( 1.8) 248(15) 264(1.9) 

213(1.8) 162 ( 3.0) 189 ( 2.8) 217( 1.8) 240 ( 2.1) 260 ( 2.1) 



School sample size is insufficient to permit reliable regional results for type of location. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 
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Parents’ Education Level 

Previous NAEP findings have shown that students who report their parents are 
better educated tend to have higher reading proficiency. 17 Table 2.3 shows the results 
for fourth-grade public school students reporting that at least one parent graduated from 
college, at least one parent had some education after high school, at least one parent 
graduated from high school, neither parent graduated from high school, or they did not 
know their parents’ education level. Note that a substantial percentage of fourth graders 
indicated that they did not know their parents’ education level. Furthermore, research 
suggests that some fourth graders’ reports on parents’ education level are almost 
certainly not accurate descriptions of their parents’ actual education levels. 18 Such 
considerations should be kept in mind when interpreting fourth grade proficiency results 
for different parental education levels. 

1994, Public School Students 

As shown in Table 2.3, public school students in Montana reporting that 
at least one parent graduated from college demonstrated an average 
reading proficiency which did not differ significantly from that of 
students who reported that at least one parent had some education after 
high school but was higher than that of students who reported that at 
least one parent graduated from high school, neither parent graduated 
from high school, or they did not know their parents’ education level. 
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TABLE 2.3 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Parents’ Level of Education 



1994 Trial State Assessment 


Average 


10th 


25th 


50th 


75th 


90th 




Proficiency 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 






College graduate 




ISIIS^ 








- ; | / 


1994 Montana 


230 ( 1,6) 


184(4.1) : : 


212(2.8) 


234 ( 1.4) 


253 ( 1.4) 


269 ( 2,5) 


West 




168 ( 4.0) 


; 201 ( 3.2) 


: 229 ( 2.3) 


251 ( 2.1) 


270(2.4). 


Nation 




168 ( 1.9) 


199(1.4) 




249 ( 1.8) 


269(1.6) | 


Some education after HS 


■ 8 li 










:: 


1994 Montana 




■ 185(6.2) 


208 ( 6.4) 


231 ( 3.1) ; • 


2m ( 3.5) 


265 ( 3.7) 


West 


. 221 < 5.1) 






224 { 76) - 


248 ( 6.1) 


.264 ( 3.0) 


Nation 




171(9.6) 


199 ( 4.3) 


226 ( j 


248 A 


||266 ( 3.9) 


High school graduate 




|lll!8ll|!l!p! 


piiililililflp 


IIWIIIPI# 






1994 Montana 


,219(2 J2) 


176 (14.0) 


200 


222 ( 1.9) 


& 24^i4l8)i: 


256 ( 3.4) ■ ■ 


West 


mmms) ■ 


140 ( 7.0) 


-I 


210(4.0) 




250 1 6.7) ' 


Nation 


206(1.9) 


149(3.0) 


181 (2$f) 


21 2 ( 0.8) 




255 ( 4.0) : . 


High school non-graduate 




.“"j " 










1994 Montana 




■li^4.9) : 




,1214 (4.3) ; t 


[:'232{&3o) :: ! 


247 (16.3) 


West 




- 135?(12;BK 




189 (10.1) 




239 < 6;8) 


Nation 


* tasf 


137(7.3) 


162 ( 8,8) 


^188(2.9), : 


216(4.3) 


236(4:3) 


1 don’t know 


" 


iiill 




\7- ■' ' 




1 


1994 Montana 




171 (4.5) 


' . 163 ( 4x3) * 




239 (1.8) ; 


257 ( 1.1) 


West 


203 < 2.4) 


147 (4A) v 




207(4.7) 


2!33 ( 24), >: 


m &mmw ' 


Nation 


-204 (1.3) 


150(3,1); 


179 { 2.2) 


20S(l/t)'fc 


i^-(T.S) 5 


253(1.9) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 
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17 Ina V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The NAEP 1992 Reading Report Card for the Nation and the 
States. (Washington, DC: National Center for Education Statistics, 1993.) 

18 _ 

E. Dianne Looker. “Accuracy of Proxy Reports of Parental Status Characteristics,” in Sociology of Education , 62(4). 
(1989). pp. 257-276. 
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Gender 

In general, NAEP reading assessment results for males and females support 
numerous studies that have revealed gender differences favoring females in reading. 19 
As shown in Table 2.4, the 1994 Trial State Assessment Program results for Montana 
are consistent with those general findings. 

1994 , Public School Students 

In public schools in Montana, girls exhibited an average reading 
proficiency which was higher than that of boys. 




TABLE 2.4 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Gender 



1994 Trial Stale Assessment 


Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 




Male 








HKiSI 






1994 Montana 


: 218 { 1.6) 






221 ( 3.3) 


242(1.5) 




West 


207{;as):K:S 




179(5.3) 


^212^3.3)^ 


^238((p2)if 




Nation 


207( 1.3) 


r;l49;(,l;8)^./: 


181(1.0) 


211 { 1^8) , 




v 


Female 










I,:::;: : v : jjg 




1994 Montana 




I|t84|»8» 


^ v 207fZ7^>t! 




( 1.1) 


266 ( 2.0) 


West 


f&kV2£i :,P 


162 ( 5.0) : 


192 ( 5.0) 




f245.$2JZ) 1 


l!S&55!(!3i9)II 


Nation 




165(1.6) 




22Z 02J3) 


245 ( 1.4) 


264 ( 2.1) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 



Proficiency According to Purpose for Reading 

Table 2.5 provides a summary of results according to each of the two purposes 
for reading by race/ethnicity, type of location, parents’ education level, and gender for 
public school students. 
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Ian Plewis. “Pupils’ Progress in Reading and Mathematics During Primary School: Associations with Ethnic Group 
and Sex,” in Educational Researcher, 33. (1991). pp. 133-140; Gita Z. Wilder and Kristin Powell, Sex Differences in 
Test Performance: A Survey of the Literature. (New York: College Entrance Examination Board, 1989). 
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TABLE 2.5 

Fourth-Grade Public School Students’ Average 
Reading Proficiency According to Purpose for Reading 
by Subpopulation 





Reading for Literary Experience 


Reading to Gain Information 


1994 


RA CE/ETHNICfTY 

White Montana 

West 
Nation 

Hispanic Montana 

West 
Nation 

American Indian Montana 

West 
Nation 

TYPE OF LOCATION* 

Central City Montana 

Nation 

Urb Fringe/Lrg Town Montana 
Nation 

Rural/Small Town Montana 

Nation 

PARENTS’ EDUCATION 

College graduate Montana 

West 
Nation 

Some educ after HS Montana 

West 
Nation 

HS graduate Montana 

West 
Nation 

HS non-graduate Montana 

West 
Nation 

1 don’t know Montana 

'West 
Nation 

GENDER 

Male Montana 

West 
Nation 

Female Montana 

West 
Nation 


: ■■ Profic 

: 223 ( 2’4) 

213(3.4} 

tssi 

sm 

- _:1 : 202 ( 3.5) : . ; ' 

/ 221(32) 

206(2.6) 

220 ( 2.0) , : 

itwiiiffiifiiiiiTriiiir r i 

216(2.0) 

.. 1 : : : : 1 ■ 

1 ' ^ 232 (1.9) 5SII :: III [ 

% C-‘4c. 

229 ( 3.8) . 

m mi 

m l|s 

- 

- : i 208 ( 2.1) : ' ■ ■ : 

216(4.9); 

: 188(6.9) 

189 ( 3.4) ; 

205 ( 2.8} 

|| 207 ( 1.3) 

219(1.9) ; 

■ . 206 ( 2.7) - 

231 ( 1.8) 

220 ( 2.8) 

221 ( 1.3! ■ 


:iency £ ' *4 y I « /•' ; ’■ ■ v ' . ' 

1 220 i 2.0} 

11I1I1 220(1.4) 

202 ( 3.9) 

: : i:i.i SS 184 ( 4.4) :ir ; ; ,■ ^ 

185 ( 2.7) 

198(4.2) 

: ■; : " 215 ( 3.7) 

201(2.3) 

221 ( 1.7) ; 

: . : yj|||||!|j!^ : ^|2Li) J ■; . 

1 

220(1.4) 

219(5.4) ' - ' : 

xm. 

111! / ;217:( : 3.0f : , illll 

201 ( 4.1) ’ 

205 < 2.0) 

203 ( 5.7) ' %} 

’ ■ ,186 (.4.4}^ ' '' ,1 

211 (IS) 

| 5 : ; . 201(1.6) 

207 { 24) 

206 ( 1.5) 

'214; kW^-4, 

■HhHBh klf*° lift 



* School sample size is insufficient to permit reliable regional results for type of location. 

The NAEP “purpose for reading” scales range from 0 to 500. The standard errors of the statistics appear in parentheses. 

It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow 
accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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PART TWO 



Reading Achievement Levels 



hile providing information about what students can do in reading is essential 
for understanding the current state of reading performance, it is also important to 
determine whether students’ present performance is adequate. Knowing what students 
can do is made even more relevant by also looking at what students should be able to 
do. For that reason, the National Assessment Governing Board (NAGB) has provided 
NAEP with achievement levels in reading that set standards for performance in reading 
at grades 4, 8, and 12. 

This report presents data using the student achievement levels as authorized by the 
NAEP legislation and adopted by the National Assessment Governing Board 
(NAGB). 20 The achievement levels are based on collective judgments, gathered from 
a broadly representative panel of teachers, education specialists, and members of the 
general public, about what students should know and be able to do relative to a body 
of content reflected in the NAEP assessment frameworks. For reporting purposes, the 
achievement level cut scores are placed on the traditional NAEP scale. For each grade, 
the results divide the scale into four ranges — Basic , Proficient , and Advanced , as well 
as the region below Basic. 

Initiated in 1990, the levels have been used to report the national and state results 
in mathematics in 1990 and 1992, as well as in reading in 1992 and 1994. The reading 
achievement levels were developed by American College Testing (ACT) under contract 
with NAGB. While setting student achievement levels on the National Assessment is 
relatively new and developing, the achievement levels are consistent with recent 
education reform efforts. Some state and local jurisdictions are also developing 
standards and reporting their test results using them. 21 



20 P.L. 103-382. Improving America’s Schools Act of 1994. 

21 States such as Kentucky, Maryland, Colorado, Connecticut, and North Carolina all have standard-setting initiatives 
resulting in student achievement levels. 
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Despite the commitment to standards-based reporting of NAEP data, the transition 
is incomplete. There have been some critical reviews and congressionally mandated 
evaluations that cast doubt on the interpretability of achievement levels and also on the 
applicability of the underlying technical methodology used to develop them. These 
studies were conducted by the General Accounting Office (GAO) 22 and the National 
Academy of Education (NAE). 23 Their findings question, for example, the application 
of the Angoff method for large scale assessments like NAEP, given the significant 
modifications required to accommodate the complexity of the NAEP item structure and 
the multiple cutpoints. They conclude that discretion should be used in making 
particular inferences about what students at each level actually know and can do. In 
addition, there were concerns that the proportion of students at certain levels, but 
particularly at the advanced levels, may be underestimated. 

On the other hand, the Angoff procedure is the most widely documented, 
researched, and frequently used method in the standard-setting field. Many well-known 
experts support the use of a modified-Angoff method on NAEP. Several critics of the 
NAE studies, 24 for example, have reaffirmed the integrity of the process employed by 
the Board and have concluded that the weight of the empirical evidence presented does 
not support the NAE’s conclusions about achievement levels or the use of the 
modified-Angoff process. In addition, the Council of Chief State School Officers’ 
advisory panel of state assessment directors, fully aware of the NAE’s conclusions, 
supported the use of the achievement levels to report the 1994 reading results. 25 

Taken together, the results of the various studies suggest the need for further 
research and development. To that end, ACT, the NAGB contractor, recently conducted 
a study in anticipation of the 1994 NAEP reading reports. The study sought to examine 
the congruence between the reading assessment framework and the descriptions of 
reading performance embodied in the levels. 26 Two different methodologies were used: 
(1) evaluation of the achievement level descriptions via statistical item mapping, and (2) 
evaluation of the achievement level descriptions via judgmental item mapping. It was 
the consensus of the participants that the reading achievement level descriptions were, 
in general, consistent with the framework and the 1994 NAEP reading assessment 
results. However, minor modifications were suggested by the study panelists. These 
modifications were incorporated into the 1994 achievement level descriptions. 



22 

General Accounting Office. Educational Achievement Standards: NAGB’ s Approach Yields Misleading 
Interpretations. (Washington, DC, 1993). 

23 

National Academy of Education. Setting Performance Standards for Student Achievement. (Stanford, CA: National 
Academy of Education, 1993). 

24 

American College Testing. Technical Report on Setting Achievement Levels on the 1992 National Assessment of 
Educational Progress in Mathematics , Reading , and Writing. (Washington, DC: National Assessment Governing 
Board, 1993); G. Cizak. Reactions to the National Academy of Education Report. (Washington, DC: National 
Assessment Governing Board, 1993); M. Kane. Comments on the NAE Evaluation of the NAGB Achievement Levels. 
(Washington, DC: National Assessment Governing Board, 1993). 

25 

Education Information Advisory Committee of the Council of Chief State School Officers. A Resolution of the 
Education Information Advisory Committee. (Alexandria, VA, 1994). 

American College Testing. Technical Report on the 1992 NAEP Reading Re-visit Study. (Iowa City, IA: American 
College Testing, 1995). 
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It should be noted that the ACT study did not address the applicability of the 
modified-Angoff procedure for the 1 994 reading assessment. Nor did it focus on the 
reasonableness of actual achievement level cut scores. However, NAGB continues to 
explore new and innovative methodologies for standard setting for NAEP. In addition, 
proceedings from a standard-setting conference held in the fall of 1994, jointly sponsored 
by NCES and NAGB, are due to be released in the fall of 1995. Given the array of 
nationally known experts in attendance, the findings will undoubtedly provide additional 
insight into this issue. 

In sum, the student achievement levels in this report have been developed carefully 
and responsibly, and have been subject to refinements and revisions in procedures as 
new technologies have become available. However, standards-based reporting for NAEP 
data is still in transition. The NAEP legislation states that the student achievement levels 
shall be “. . . developed through a national consensus approach . . . used on a 
developmental basis, . . . and updated as appropriate.” It requires that their 
developmental status be clearly stated in NAEP reports. Upon review of the available 
information, the Commissioner of NCES has judged that the achievement levels are in 
a developmental status. However, the Commissioner and the Governing Board also 
believe that the achievement levels are useful and valuable in reporting on the 
educational achievement of American students. 

Part Two of this report focuses on results of the 1994 Trial State Assessment 
Program in terms of the NAGB achievement levels. Chapter 3 provides an overview 
of the achievement level descriptors. In addition, the percentages of public school 
students in Montana, the West region, and across the nation who performed at or above 
each of the achievement levels in 1994 are presented. Chapter 4 expands on these results 
by presenting achievement level data for subgroups — race/ethnicity, type of location, 
level of parents’ education, and gender. 
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CHAPTER 3 



Students’ Reading Achievement 

The most recent reauthorization of the National Assessment Governing Board 
(NAGB) continues the Board’s responsibilities to set policy for NAEP and to “develop 
appropriate student achievement levels for each age and grade in subject areas tested” 
(Pub. L. 103-382). As a result, students’ reading proficiencies presented in the previous 
section can be viewed in the context of established goals for performance. This report 
next presents results based on the National Assessment Governing Board’s goals for 
students’ achievement on the NAEP reading scale. 27 

Achievement goals are determined through collective judgments about how 
students should perform. These judgments are associated with specific points on the 
NAEP scale that serve to identify boundaries between levels of achievement for each 
grade — Basic, Proficient, and Advanced. Performance at the Basic level denotes partial 
mastery of the knowledge and skills that are fundamental for proficient work. The 
central level, called Proficient, represents solid academic performance. Students 
reaching this level demonstrate competency over challenging subject matter. 
Performance at the Advanced level signifies superior performance beyond proficient 
grade-level mastery. In this report, the proportion of students attaining the three 
achievement levels is presented for the 1994 assessment. 

Definitions of the three levels of reading achievement are given in Figure 3.1. 
Examples of questions at the achievement levels are also provided. The reading 
passages that accompany these questions can be found in Appendix B. It should be 
noted that constructed-response questions occur at all levels of reading achievement. 



27 Appendix C briefly describes the process of gathering expert judgments about Basic, Proficient, and Advanced 
performance — as defined by NAGB policy — on each reading item, combining the various judgments on the various 
items and mapping them onto the scale, and setting the scale score cutpoints for reporting purposes based on these 
levels. 
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FIGURE 3.1 

Levels of Reading Achievement at Grade 4 



The following achievement level descriptions focus on the interaction of the 
reader, the text, and the context. They provide some specific examples of reading 
behaviors that should be familiar to most readers of this document. The specific 
examples are not inclusive; their purpose is to help clarify and differentiate what readers 
performing at each achievement level should be able to do. While a number of other 
reading achievement indicators exist at every level, space and efficiency preclude an 
exhaustive listing. The achievement levels are cumulative from Basic to Proficient to 
Advanced. One level builds on the previous levels such that knowledge at the Proficient 
level presumes mastery of the Basic level, and knowledge at the Advanced level 
presumes mastery of both the Basic and Proficient levels. 
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BASIC 


Fourth-grade students performing at the Basic level should demonstrate an 




understanding of the overall meaning of what they read. When reading texts 


LEVEL 


appropriate for fourth graders, they should be able to make relatively obvious 


(208) 


connections between the text and their own experiences and extend the ideas in 




the text by making simple inferences. 



For example, when reading literary text, Basic-level students should be able to tell what the story is generally 
about — providing details to support their understanding — and be able to connect aspects of the stories to their own 
experiences. 

When reading informational text, Basic-level fourth graders should be able to tell what the selection is generally 
about or identify the purpose for reading it; provide details to support their understanding; and connect ideas from the text 
to their background knowledge and experiences. 





Fourth-grade students performing at the Proficient level should be able to 


PROFICIENT 


demonstrate an overall understanding of the text, providing inferential as well as 




literal information. When reading text appropriate to fourth grade, they should be 




able to extend the ideas in the text by making inferences, drawing conclusions, and 


(238) 


making connections to their own experiences. The connection between the text 


'f) .if- ?£% 


and what the student infers should be clear. 



Specifically, when reading literary text. Proficient-level fourth graders should be able to summarize the story, 
draw conclusions about the characters or plot, and recognize relationships such as cause and effect. 

When reading informational text. Proficient-level students should be able to summarize the information and 
identify the author’s intent or purpose. They should be able to draw reasonable conclusions from the text, recognize 
relationships such as cause and effect or similarities and differences, and identify the meaning of the selection’s key 
concepts. 







Fourth-grade students performing at the Advanced level should be able to 
generalize about topics in the reading selection and demonstrate an awareness of 
how authors compose and use literary devices. When reading text appropriate to 
fourth grade, they should be able to judge texts critically and \ in general , give 
thorough answers that indicate careful thought. 



Specifically, when reading literary text. Advanced-level students should be able to make generalizations about 
the point of the story and extend its meaning by integrating personal and other reading experiences with the ideas 
suggested by the text. They should be able to identify literary devices such as figurative language. 

When reading informational text. Advanced-level fourth graders should be able to explain the author’s intent 
by using supporting material from the text. They should be able to make critical judgments of the text (including its form 
and content) and explain their judgments clearly. 
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FIGURE 3-1 (continued) 

Levels of Reading Achievement at Grade 4 



The following questions were selected as examples of the types of questions that 
students at each of the three achievement levels can respond to effectively. The example 
questions were selected from the 1992 or 1994 NAEP reading assessments. These 
questions are based on the stories “Sybil Sounds the Alarm” and “Hungry Spider and 
the Turtle,” which are shown in their entirety in Appendix B. “Sybil Sounds the Alarm” 
is a fictional account of a historical event that describes the courage of a young colonial 
girl in riding her horse to warn of the approaching British army. “Hungry Spider and 
the Turtle” is a fable that presents a humorous portrayal of two characters and the jokes 
they play on each other. Both stories were used to assess reading for literary experience. 

For the multiple-choice questions, the correct answer is marked with an asterisk. 
For the constructed-response questions, a description of acceptable answers is provided. 
Also shown are the national overall percent correct and the percent correct for the 
students performing within the interval of the indicated level. For example, students 
with an average reading proficiency in the range 208-237 are in the Basic interval: at 
or above the cutpoint for the Basic level and below the cutpoint for the Proficient level. 

Samples of student responses to these and other constructed-response questions in 
the NAEP reading assessment appear in the Reading Assessment Redesigned f 28 report 
which provides an in-depth look at the assessment materials and tasks. Also, a 
presentation of sample student responses can be found in the 1994 NAEP Reading Report 
Card . 



CARD 



NATION’S 


Ml 




; 











1994 Trial State Assessment 



1 


Sybil Sounds the Alarm 


Sybil’s father thought that she 

A. was obedient but forgetful 
* B. was courageous and a good rider 

C. could lead the troops against the British 

D. could easily become angry 


1992 Overall Percentage Correct 


1992 Conditional Percentage Correct 


Nation 


71 (1.4) 


Nation 


75 (2.4) 



28 J.A. Langer, J.R. Campbell, S.B. Neuman, I.V.S. Mullis, H.R. Persky, and P.L. Donahue. 
Redesigned. (Washington, DC: National Center for Education Statistics, 1995). 
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FIGURE 3.1 (continued) 

Levels of Reading Achievement at Grade 4 



1994 Trial State Assessment 



BASIC LEVEL 
Example Question 


Hungry Spider and the Turtle 


Who do you think would make a better frien 
Spider or Turtle? Explain why. 


d, 

: a better friend 
t of the 










Acceptable responses indicated which character would make 
and provided appropriate evidence from the story in suppor 
selection. 


1994 Overall Percentage Acceptable 


1994 Conditional Percentage Acceptable 
for Basic Interval 


Nation 


62 (1.4) 


Nation 


68 (2.3) 




PROFICIENT LEVEL 

Example Question 


Sybil Sounds the Alarm 


The information about the statue and stamp helps 
to show that 

* A. people today recognize and respect Sybil’s bravery 

B. people were surprised that George Washington honored her 

C. the author included minor details 

D. heroes are honored more now than they were then 


1992 Overall Percentage Correct 


for Proficient Interval 


Nation 


62 (1.5) 


Nation 


87 (3.4) 
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FIGURE 3.1 (continued) 

Levels of Reading Achievement at Grade 4 



PROFICIENT LEVEL 

Example Question I 


Hungry Spider and the Turtle 


What do Turtle’s actions at Spider’s house t< 
you about Turtle? 


:ii 

is consistent 
of the story. 










Acceptable responses provided a description of Turtle that 
with the traits portrayed by the character in a specific part > 


1994 Overall Percentage Acceptable 


1994 Conditional Percentage Acceptable 
for Proficient Interval 


Nation 


41 (1.4) 


Nation 


64 (3.0) 







Sybil Sounds the Alarm 



How does the author show the excitement and 
danger of Sybil’s ride? 



Acceptable responses described a specific element of the author’s portrayal 
of Sybil that contributed to the story’s atmosphere and tone. 



Nation 



44 (1.7) 



OQD : i: I f, An 1 ntoAfi A 



Nation 



83 (4.9) 



5 
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FIGURE 3.1 (continued) 

Levels of Reading Achievement at Grade 4 



1994 Trial Slate Assessment 
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Hungry Spider and the Turtle 



Think about Spider and Turtle in the story. 
Pick someone you know, have read about, 
or have seen in the movies or on television 
and explain how that person is like either 
Spider or Turtle. 



Responses that were rated as Essential or better demonstrated adequate 
understanding of the character of Spider or Turtle by providing any 
story-supported character trait and relating or linking that trait to a real 
world person or character. 



or Better for Advanced Interval 




Nation 



Nation 



73 ( 8 . 6 ) 
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Table 3.1 provides the percentage of fourth-grade public school students at or 
above each achievement level, as well as the percentage of students below the Basic 
level. 



1994 , Public School Students 

The percentage of public school students in Montana who were at or 
above the Proficient level (35 percent) was higher than that of students 
across the nation (28 percent). 
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TABLE 3.1 

Levels of Fourth-Grade Public School Students ’ 
Reading Achievement 



1994 Trial State Assessment 


At or Above At or Above 

Advanced Proficient 


At or Above 
Basic 


Below 

Basic 


1994 Public 

Montana 

West 

Nation 


v' ^ % Percentage ' 

7 ( 0.7) 35( 1.5) 69(1.7) 31 ( 1.7) 

'<V7 ^ ’ !' ~4i<22) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 
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Many students in Montana were unable to meet the Proficient achievement level 
that represents solid academic performance in reading. Educators and policy makers 
will need to look to many sources of information and opinion for explanations of these 
levels of achievement. Among the possible explanations, several factors should not be 
overlooked. First, students may not be learning enough in school to reach the 
achievement levels. In 1983, the National Commission on Excellence in Education 
warned that “the educational foundations of our society are being eroded by a rising tide 
of mediocrity that threatens our very future.” 29 In 1990, the president and the governors 
committed the nation to six goals for education, the third of which called for American 
students to “leave grades four, eight and twelve having demonstrated competency in 
challenging subject matter.” 30 Many political leaders of this nation continue to express 
dissatisfaction with the performance of American students. These NAEP findings 
confirm that a great many American students are not yet performing at high levels. 

Second, some students may not be reaching the higher achievement levels because 
schools may not be teaching the elements of reading that are included on the NAEP 
assessment, and because the assessment may not be covering some elements of reading 
included in the school curriculum. No assessment or test can cover all the different areas 
of reading that are taught in school. The content coverage of the NAEP reading 
assessment was set by a consensus approach. Teachers, curriculum specialists, subject 
matter specialists, local school administrators, parents, and members of the general 
public actively participated in deciding what are the most important elements of reading 
to be included in the assessment and for students to learn. 31 

Third, the Basic, Proficient, and Advanced achievement levels reflect high 
standards for the 1 994 NAEP reading scale. The establishment of achievement levels 
depends on securing a set of informed judgments of expectations for student educational 
achievement and on summarizing the individual ratings into collective judgments. These 
expectations reflect the Board’s policy definitions, which require that students at the 
central, Proficient level demonstrate “competency over challenging subject matter.” The 
resulting standards are rigorous. 

As measures of performance, both average proficiency scores and percentages of 
students who score at or above the critical achievement levels on the NAEP scale 
provide a valuable overall depiction of students’ reading ability. 



29 

National Commission on Excellence in Education. A Nation at Risk. (Washington, DC: U.S. Department of 
Education, 1983). In 1988, then-Secretary Bennett reported that the “precipitous downward slide of previous decades 
has been arrested, and we have begun the long climb back to reasonable standards.” (p. 1 in American Education: 
Making it Work . (Washington, DC: U.S. Department of Education, 1988).). 

30 U.S. Department of Education. America 2000: An Education Strategy. (Washington, DC: U.S. Department of 
Education, 1991). 

31 NAEP Reading Consensus Project. Reading Framework for the 1992 and 1994 National Assessment of Educational 
Progress. (Washington, DC: National Assessment Governing Board, U.S. Department of Education, 1994). 
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CHAPTER 4 



Reading Achievement of Fourth-Grade 
Students by Subpopulations 

Assessment results repeatedly show differences in performance for subpopulations 
of students. 32 This chapter presents achievement level results for subgroups of public 
school students from Montana defined by race/ethnicity, type of location, level of 
parents’ education, and gender. 

Race/Ethnicity 

Table 4.1 provides the percentage of public school students at or above each of 
the three achievement levels and also the percentage below the Basic level for White, 
Hispanic, and American Indian students. 

1994, Public School Students 

In 1994, the percentage of White students in Montana who attained the 
Proficient level was greater than that of Hispanic and American Indian 
students. 



ERIC 



32 Ina V.S. Mullis, John A. Dossey, Jay R. Campbell, Claudia A. Gentile, Christine O’Sullivan, and Andrew S. Latham. 
NAEP 1992 Trends in Academic Progress. (Washington, DC: National Center for Education Statistics, 1994). 
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TABLE 4.1 

Levels of Fourth-Grade Public School Students ’ 
Reading Achievement by Race/Ethnicity 



1994 Trial State Ass e ssment 




The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). *** Sample 
size is insufficient to permit a reliable estimate. 
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Type of Location 

Table 4.2 presents reading performance by achievement levels for fourth-grade 
students attending public schools in central cities, urban fringe/large towns, and rural 
areas/small towns. 



1994, Public School Students 

In Montana, the percentage of students attending public schools in 
central cities who attained the Proficient level was not significantly 
different from that of students in urban fringe/large towns but was 
smaller than that of students in rural areas/small towns. 
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TABLE 4.2 

Levels of Fourth-Grade Public School Students’ 
Reading Achievement by Type of Location 



1994 Trial State Assessment 



At or Above 



At or Above 



At or Above 



Below 



Advanced 



Proficient 



Basic 



Basic 



Central City 
1994 Montana 
Nation 

Urban Fringe/Large Town 
1994 Montana 
Nation 

Rural/Small Town 
1994 Montana 
Nation 




School sample size is insufficient to permit reliable regional results for type of location. 

The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 



o 

ERIC 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



53 



Montana 



Parents 9 Education Level 

Table 4.3 shows the reading achievement level results for fourth-grade public 
school students who reported that at least one parent graduated from college, at least 
one parent had some education after high school, at least one parent graduated from high 
school, neither parent graduated from high school, or they did not know their parents’ 
education level. 



1994 , Public School Students 

In Montana, the percentage of students reporting that at least one parent 
graduated from college who performed at or above the Proficient level 
was not significantly different from that of students who reported that 
at least one parent had some education after high school but was larger 
than that of students who reported that at least one parent graduated 
from high school, neither parent graduated from high school, or they did 
not know their parents’ education level. 
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TABLE 4.3 

Levels of Fourth-Grade Public School Students’ 
Reading Achievement by Parents’ Level of Education 



1994 Trial State Assessment 



At or Above 
Advanced 



At or Above 
Proficient 



At or Above 
Basic 



Below 

Basic 



Percentage 



College graduate 
1994 Montana 
West 
Nation 

Some education after HS 
1994 Montana 
West 
Nation 

High school graduate 
1994 Montana 
West 
Nation 

High school non-graduate 
1994 Montana 
West 
Nation 

I don't know 
1994 Montana 
West 
Nation 





36 ( 2.9) 

W1M9) 

Sj£? 








iRM 

rt|52(5.0> 
60 ( 8 

■ I37!(:&tji 

I|i 60 :( 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 
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Gender 

Table 4.4 provides the achievement level results by gender for fourth-grade public 
school students. 



1994, Public School Students 

The percentage of males in Montana public schools who attained the 
Proficient level was smaller than that of females. 
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TABLE 4.4 

Levels of Fourth-Grade Public School Students' 
Reading Achievement by Gender 



1994 Trial State Assessment 


At or Above 
Advanced 


At or Above 
Proficient 


At or Above 
Basic 


Below 

Basic 


Male 

1994 Montana 
West 
Nation 

Female 

1 994 Montana 
West 
Nation 


•: Percentage 1 ;! g v ( y; ;;)■ 1 | 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 
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PART THREE 



Finding a Context for Understanding 
Students’ Reading Proficiency in Public 
Schools 

Information on the reading proficiency of students in Montana can be better 
understood and used for improving instruction and setting policy when supplemented 
with contextual information about schools, teachers, and students. 

To gather contextual information, the fourth-grade students participating in the 
1994 Trial State Assessment Program, their reading teachers, and the principals or other 
administrators in their schools were asked to complete questionnaires on instruction, 
programs, and policies. The student, teacher, and school data help to describe some of 
the current practices in reading education, to illuminate some of the factors that appear 
to be related to fourth-grade public school students’ reading proficiency, and to provide 
an educational context for understanding information on student achievement. 

It is important to note that the NAEP data cannot establish cause-and-effect links 
between various contextual factors and students’ reading proficiency. However, the 
results do provide information about important relationships between the contextual 
factors and proficiency. Through the questionnaires administered to students, teachers, 
and principals, NAEP is able to provide a broad picture of educational practices 
prevalent in American schools and classrooms. 

Part Three consists of four chapters. Chapter 5 discusses policies and practices 
related to reading. Chapter 6 focuses on instructional approaches — how instruction is 
delivered. Chapter 7 provides information about teachers, and Chapter 8 examines 
students’ home support for literacy. 
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CHAPTER 5 



Policies and Practices Related to Reading 

This chapter focuses on curricular and instructional content issues in Montana 
public schools and their relationship to students’ reading proficiency. Table 5.1 
provides a profile of the reading policies and practices in the public schools with fourth 
grades in Montana. Some of the selected results obtained from teacher and school 
questionnaires reveal: 

• According to the public school administrators in Montana in 1994, 

60 percent of the fourth-grade students were in schools where reading 
was identified as receiving special emphasis. This percentage was 
smaller than that of students across the country (85 percent). 

• In 1994, according to their reading teachers, 17 percent of the students 
in public schools in Montana were typically taught reading in a class that 
was grouped by reading ability. The prevalence of ability grouping was 
not significantly different across the nation (22 percent). 
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TABLE 5.1 

Reading Policies and Practices in Fourth-Grade Public 
Schools 



1994 Trial State Assessment 



Montana 



West 



Nation 



Percentage of students in public schools that identified 
reading as a priority in schoolwide goals and objectives, 
instruction, workshops, etc. 

1994 

Percentage of students in public schools who are assigned 
to a reading class by their ability 
1994 

Percentage of students in public schools who stay with the 
same teacher for all academic subjects 
1994 

Percentage of students in public schools who remain with 
one teacher for most subjects but may have a different 
teacher for one or two subjects 
1994 

Percentage of students in public schools in which a reading 
curriculum specialist is available to hetp or advise 
1994 

Percentage of students in public schools that use parents 
as aides in classrooms 
1994 






* 60 C:4||pi8 ; 

' 17 ( 2.9) 



61 (4,8) 

. | ? 38 ( 4.8} -■ 
45 ( 3.5) 

93 ( 2.6) 



Percentage 

76 ( 7,0) : 

I- ' 14(5.8) : \ 
62 ( 62 ) 

35(6.5) 

tiilllf) ■ | 

93 < 3.5) 



iiiiplisii 1 



; ;■ 

4.0) | 

1 WM, 




The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 
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Time for Instructional Activities 

To begin to place students’ reading proficiency in context, it is useful to examine 
the extent to which fourth-grade students’ reading teachers in Montana are spending their 
time on instructional activities. Teachers of the assessed students were asked to report 
on the amount of time they spent with each class for reading instruction on a typical day. 
Table 5.2 shows the results for public school students. 33 

• In 1994, the percentage of students in Montana who had reading teachers 
who spent 60 minutes providing reading instruction each day 
(54 percent) was larger than that across the nation (44 percent). 

• In Montana in 1994, average reading proficiency was similar for students 
regardless of how much time their reading teachers spent on reading 
instruction on a typical day. 
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TABLE 5.2 

Public School Teachers y Reports on Time Spent 
Teaching Reading 



1994 Trial State Assessment 



Montana 



West 




About how much time do you spend for 
reading instruction on a typical day? 

45 minutes or less 
1994 

60 minutes 
1994 

90 minutes or more 
1994 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 
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33 For every table in the body of the report that includes estimates of average proficiency, the Data Appendix provides 
a corresponding table presenting the results for the four subpopulations — race/ethnicity, type of location, parents’ 
education level, and gender. 
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Instructional Resources for Reading 

Teachers’ use of resources is obviously constrained by the availability of those 
resources. Thus, the assessed students’ teachers were asked about the extent to which 
they were able to obtain all of the instructional materials and other resources they 
needed. From Table 5.3: 

• In 1994, the percentage of fourth-grade students in public schools in 
Montana who were being taught by teachers who reported getting all 
of the resources they needed (11 percent) did not differ significantly 
from the corresponding percentage of students across the nation 
(9 percent). 

• Furthermore, in 1994, the percentage of public school students in 
Montana whose teachers got only some or none of the resources they 
needed (31 percent) did not differ significantly from that of students 
across the nation (35 percent). 

• In 1994, public school students in Montana whose teachers got all of the 
resources they needed had an average reading proficiency (228) which 
was not significantly different from that of students whose teachers got 
only some or none of the resources they needed (223). 



TABLE 5.3 

Public School Teachers’ Reports on the Availability 
of Resources 



Which of the following statements is true 
about how well your school system 
provides you with the instructional 
materials and other resources you need 
to teach your class? 

I get all the resources I need. 

1994 

I get most of the resources I need. 

1994 

I get some or none of the resources I need. 

1994 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 
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CHAPTER 6 



How Is Reading Instruction Delivered? 

Effective classroom instruction can help students become thoughtful readers. 34 
The instructional activities that students complete can also lead them to view reading in 
particular ways 35 and to focus their efforts on developing certain skills and strategies. 
To provide information about how instruction is delivered in Montana, fourth-grade 
students participating in the Trial State Assessment Program and their reading teachers 
were asked to report on the use of various teaching and learning activities in their 
reading classrooms. 

Instructional Materials for Reading 

Basal reading programs are a traditional part of reading instruction in this country. 
They typically include a compilation of reading passages and exercises, as well as 
ancillary materials, such as workbooks and tests. These types of programs account for 
at least two-thirds of all expenditures for reading instruction and are used in more than 
95 percent of all school districts through grade 6. 36 However, other types of reading 
programs may utilize trade books, such as story or informational books, that are not 
necessarily published for the sole purpose of reading instruction. When students 
encounter a variety of texts, they expand their general understanding of language, as 
well as their understanding of text and its underlying structures. 37 To provide 
information about instructional materials used for fourth-grade classes, students’ reading 
teachers were asked to report about the type of materials that formed the core of their 
reading program. Table 6.1 provides the results. 



ERIC 



34 A. P. Sweet. Transforming Ideas for Teaching and Learning to Read. (Washington, DC: Office of Educational 
Research and Improvement, 1993). 

35 J.A. Dole, G.G. Duffy, L.R. Roehler, and P.D. Pearson. “Moving from the Old to the New: Research on Reading 
Comprehension Instruction,” in Review of Educational Research, 61. (1991). pp. 239-264. 

36 Jeanne S. Chall and James R. Squire. “The Publishing Industry and Textbooks,” in R. Barr, M. Kamil, P. Mosenthal, 
and P.D. Pearson, Eds., Handbook of Reading Research, Volume II. (New York, NY: Longman, 1991). 

37 V. J. Harris. “Literature-Based Approaches to Reading Instruction,” in Review of Research in Education. (Washington, 
DC: American Educational Research Association, 1993). - 
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According to Montana public school reading teachers, in 1994: 

• Students in Montana whose teachers used both basal and trade books 
demonstrated an average reading proficiency (222) which did not differ 
significantly from that of students whose teachers primarily used basal 
readers (224). 

• The proficiency of Montana students whose teachers used both basal and 
trade books (222) was not significantly different from that of students 
whose teachers primarily used trade books (225). 

• The proficiency of Montana students whose teachers primarily used 
trade books (225) was not significantly different from that of students 
whose teachers primarily used basal readers (224). 
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TABLE 6.1 

Public School Teachers ’ Reports on Instructional 
Materials for Reading 



1994 Trial State Assessment 


Montana 


West 


Nation 


What type of materials form the 
core of your reading program? 

Primarily basal 
1994 

Primarily trade books 
1994 

Both basal and trade books 
1994 

Other 

1994 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 
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Teachers were also asked about their use of specific types of resources that can 
add depth and variety to the reading program (Table 6.2). Some selected results for 
public school students reveal that, in 1994: 

• In Montana, 44 percent of the fourth-grade students had reading 
teachers who used children’s newspapers and/or magazines at least once 
a week. This percentage was greater than that for the nation 
(30 percent). 

• The percentage of Montana students who had reading teachers who used 
reading kits at least once a week (15 percent) was smaller than that for 
students in the nation (21 percent). 

• The percentage of students in Montana who had reading teachers who 
used computer software for reading instruction at least once a week 
(18 percent) was not significantly different from that for the nation 
(24 percent). 

• In Montana, 73 percent of the students had reading teachers who used 
a variety of books at least once a week. This figure was not significantly 
different from that for students across the nation (75 percent). 

• The percentage of students in Montana who had reading teachers who 
used materials from other subject areas at least once a week (75 percent) 
did not differ significantly from that for the nation (69 percent). 



Teachers can nurture students’ developing reading ability by providing 
instructional activities that prepare students for a wide variety of specific reading 
tasks. 38 Effective activities support students’ understanding of the text being read and 
model the ways in which students can control the process of building meaning when 
reading on their own. 39 To provide information about the instructional activities in 
which fourth-grade students are engaged, the students participating in the Trial State 
Assessment Program and their reading teachers were asked to report on the frequency 
with which the teachers asked the students to do a variety of activities. The students’ 
and teachers’ responses are presented in the three following sections — workbooks, 
worksheets, and writing; discussions and group activities; and time to read. The 
students’ and teachers’ responses sometimes reflect different perceptions of the 
frequency of some activities. 



38 S.G. Paris. ‘Teaching Children to Guide Their Reading and Learning,” in Taffy E. Raphael, Ed., The Contexts of 
School-Based Literacy. (New York, NY: Random House, 1984). pp. 115-130. 

39 

A.P. Sweet Transforming Ideas for Teaching and Learning to Read. (Washington, DC: Office of Educational 
Research and Improvement, 1993). 



Instructional Activities 
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TABLE 6.2 

Public School Teachers’ Reports on Resources for 
Reading Instruction 



1994 Trial State Assessment 



Montana 



West 



Nation 



How often do you use the following 
resources to teach reading? 

Children’s newspapers and/or magazines 
At least once a week 1 994 

Once or twice a month 1994 

Never or hardly ever 1994 

Reading kits 

At least once a week 1 994 
Once or twice a month 1 994 

Never or hardly ever 1994 

Computer software for reading instruction 
At least once a week 1 994 

Once or twice a month 1 994 

Never or hardly ever 1994 

A variety of books (e.g., novels, collections 
of poetry, nonfiction) 

At least once a week 



Once or twice a month 
Never or hardly ever 



1994 

1994 

1994 



Materials from other subject areas 
At least once a week 1994 

Once or twice a month 1 994 

Never or hardly ever 1994 



Percentage and Proficiency 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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Workbooks, Worksheets, and Writing 

Some educators and researchers have suggested that children spend a 
disproportionate amount of time completing workbook tasks rather than receiving 
reading instruction or actively constructing their own understandings. 40 Analyses of 
workbook and worksheet activities reveal that many of these tasks require only a 
perfunctory level of reading. 4 ' Although we do not know what specific activities 
constitute time spent on workbooks and worksheets, such tasks rarely require students 
to engage in any extended writing. Writing activities have been found to incite 
children’s interest and involvement in learning about language and to enhance their 
reading comprehension. 42 To examine the use of workbooks, worksheets, and the 
reading/writing connection, students and their reading teachers were asked about the 
frequency with which teachers asked students to work in a reading workbook or on a 
worksheet or to write about something they had read. Table 6.3 provides these results. 

In 1994, according to the fourth-grade public school students in Montana: 

• The percentage of students who were asked to work in a reading 
workbook or on a worksheet almost every day (51 percent) was greater 
than the percentage of students who were asked to write about 
something they have read almost every day (18 percent). 

• Students who were asked to work in a reading workbook or on a 
worksheet almost every day demonstrated an average reading 
proficiency (225) which was higher than that of students who did this 
activity less than weekly (215). 

• The average reading proficiency of students who were asked to write 
about something they have read almost every day (220) was not 
significantly different from that of students who were asked to do this 
less than weekly (223). 

And, according to their reading teachers: 

• The percentage of students who were asked to work in a reading 
workbook or on a worksheet almost every day (25 percent) was not 
significantly different from the percentage of students who were asked 
to write about something they have read almost every day (29 percent). 



40 P.D. Pearson, L.R. Roehler, J.A. Dole, and G.G. Duffy. “Developing Expertise in Reading Comprehension,” in S.J. 
Samuels and A.E. Farstrup, Eds., What Research Has to Say About Reading Instruction. (Newark. DE: International 
Reading Association, 1992); R.C. Anderson, E.H. Hiebert, J.A. Scott, and I.A.G. Wilkinson. Becoming a Nation of 
Readers: The Report of the Commission on Reading. (U.S. Department of Education: The National Institute of 
Education, 1985). 

41 J.R. Campbell, B.A. Kapinus, and A.S. Beatty. Interviewing Children About Their Literacy Experiences. (Washington, 
DC- National Center for Education Statistics, Government Printing Office, 1995); J. Osbom. “Workbooks: Counting, 
Matching, and Judging,” in J. Osbom, P.T. Wilson, and R.C. Anderson Eds.. Reading Education: Foundations for a 
Literate America. (Lexington, M A: Lexington Books, 1985). 

42 S D Miller T Adkins and M.L. Hooper. “Why Teachers Select Specific Literacy Assignments and Students’ 
Reactions to Them,” in Journal of Reading Behavior , 25(1), 69-93. 1993; D.C. Simmons, E.J. Kameeuni, S. Dickson, 
D. Chard, B. Gunn, and S. Baker. “Integrating Narrative Reading Comprehension and Writing Instruction for All 
Learners,” in Multidimensional Aspects of Literacy Research, Theory, and Practice. (Chicago, IL: National Reading 
Conference, 1994). 
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• Students who were asked to work in a reading workbook or on a 
worksheet almost every day demonstrated an average reading 
proficiency (220) which was not significantly different from* that of 
students who did this activity less than weekly (226). 

• The reading proficiency of students who were asked to write about 
something they have read almost every day (221) was not significantly 
different from that of students who were asked to do this less than 
weekly (223). 
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TABLE 6.3 

Public School Teachers * and Students’ Reports on 
Workbooks, Worksheets, and Writing 



1994 Trial State Assessment 



Montana 



Teacher Student 



West 



Teacher Student 



Nation 



Teacher Student 



How often do you (does 
your teacher) do each of 
the foliowing as a part of 
reading instruction? 

Ask students to work in a reading 
workbook or on a worksheet 
Almost every day 1 994 

At least once a week 1994 

Less than weekly 1994 

Ask students to write about 
something they have read 

Almost every day 1994 

At least once a week 1994 

Less than weekly 1994 



Percentage and Proficiency 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 
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ficance” here refers to “statistical significance.” (See 
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Discussion and Group Activities 

Discussion-related activities are an important part of classroom learning, because 
they provide opportunities for students to ask questions about things they do not 
understand or want to know more about. A lack of emphasis on group work or the 
sharing of different interpretations limits opportunities students have for discovering that 
their reactions or interpretations may not be the only ones justified by the text. 43 
Furthermore, working in groups and discussing reading provide opportunities for 
students to develop language and communication skills that are necessary for literacy 
learning. 

To examine the prevalence of discussion-related activities, students and their 
reading teachers were asked about how frequently the students discussed new or difficult 
vocabulary, talked with each other about what they have read, or did a group activity 
or project about what they have read (Table 6.4). 

In 1994, according to the fourth-grade students in public schools: 

• About one third of the students in Montana (32 percent) were asked to 
discuss new or difficult vocabulary almost every day. This percentage 
did not differ significantly from that of students across the nation 
(32 percent). 

• The percentage of students in Montana who were asked to talk with each 
other almost every day about what they have read (13 percent) was 
smaller than that of students across the nation (17 percent). 

• Relatively few of the students in Montana (12 percent) were asked to 
do a group activity or project about what they have read almost every 
day. This figure was somewhat smaller than that of students across the 
nation, where 15 percent of the students were asked to do this. 



And, according to their reading teachers: 

• In Montana, 59 percent of the students were asked to discuss new or 
difficult vocabulary almost every day. This percentage did not differ 
significantly from that of students across the nation (62 percent). 

• The percentage of students in Montana who were asked to talk with each 
other almost every day about what they have read (39 percent) was not 
significantly different from that of students across the nation, where 
34 percent of the students were asked to do this activity almost every 
day. 

• A small percentage of the students in Montana (8 percent) were asked 
to do a group activity or project about what they have read almost every 
day. This figure was not significantly different from that of students 
across the nation (5 percent). 



7 2 



43 J. Moffett and B. Wagner. “Student Centered Reading Activities,” in English Journal 80. 1991. 
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TABLE 6.4 

Public School Teachers 9 and Students’ Reports on the 
Frequency of Discussion and Group Activities 



1994 Trial State Assessment 



Montana 


West 


Nation 


Teacher 


Student 


Teacher 


Student 


Teacher 


Student 



How often do you (does 
your teacher) do each of 
the following as a part of 
reading instruction? 

Discuss new or difficult vocabulary 



Almost every day 


1994 


At least once a week 


1994 


Less than weekly 


1994 



Ask students to talk with each other 
about what they have read 



Almost every day 


1994 


At least once a week 


1994 


Less than weekly 


1994 


Ask students to do a group activity 
or project about what they have read 


Almost every day 


1994 


At least once a week 


1994 


Less than weekly 


1994 



Percentage and Proficiency 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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Time to Read 

Independent reading continues to be a major contributor to reading fluency. 44 In 
contrast to completing workbook pages or computer drills, the reading of books provides 
practice in the whole act of reading. However, some studies have suggested that 
students may not be asked to read in school as frequently as is necessary to support 
literacy development. 45 

Both the fourth-grade students and their reading teachers were questioned about 
the frequency with which the teachers asked the students to read aloud or read silently, 
or gave the students time to read books of their own choosing. Table 6.5 provides this 
information. 

According to the fourth-grade public school students in 1994: 

• The percentage of students in Montana who were asked to read aloud 
almost every day (42 percent) did not differ significantly from that of 
students across the nation who were asked to read aloud almost every 
day (45 percent). 

• About two thirds of the students (69 percent) were asked to read silently 
almost every day. This figure was larger than that for the nation 
(64 percent). 

• In Montana, 59 percent of the students were given time to read books 
of their own choosing almost every day. This percentage was larger 
than that of students nationwide (53 percent). 

And, according to their reading teachers: 

• More than half of the students in Montana (58 percent) were asked to 
read aloud almost every day. This figure was not significantly different 
from that of students across the nation, where 57 percent of the students 
were asked to read aloud almost every day. 

• The percentage of students in Montana who were asked to read silently 
almost every day (75 percent) was not significantly different from that 
of students across the nation (74 percent). 

• About two thirds of the students in Montana (69 percent) were given 
time to read books of their own choosing almost every day. This did 
not differ significantly from the percentage of students across the nation 
(69 percent). 



O 

ERIC 



44 I. Wilkinson, J.L. Wardrop, and R.C. Anderson. “Silent Reading Reconsidered: Reinterpreting Reading Instruction 
and Its Effects,” in American Educational Research Journal, 25(1). (1988). pp. 127-144; C.S. Huck. “Literacy and 
Literature,” in Language Arts, 69. (1992). pp. 520-526. 

45 R.C. Anderson, E.H. Hiebert, J.A. Scott, and I.A.G. Wilkinson. Becoming a Nation of Readers: The Report of the 
Commission on Reading. (U.S. Department of Education: The National Institute of Education, 1985); M.A. Foertsch. 
Reading In and Out of School. (Washington, DC: National Center for Education Statistics, 1992). 
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TABLE 6.5 

Public School Teachers’ and Students’ Reports on the 
Frequency of Reading in Class 



1994 Trial State Assessment 



Montana 



Teacher Student 



West 



Teacher Student 



Nation 



Teacher Student 



How often do you (does 
your teacher) do each of 
the following as a part of 
reading instruction? 



Percentage and Proficiency 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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Reading and Use of Libraries 

Analysis of schools that have been successful in promoting independent reading 
suggests that one of the keys is ready access to books. 46 Libraries can be a major 
resource in developing students’ reading abilities because students can use them as quiet 
places to read as well as to check out books and to obtain reference information. 47 Thus, 
to examine library use, students’ reading teachers were asked about the frequency with 
which they sent or took their reading classes to the library and assigned students to read 
a book from the library. Table 6.6 provides the results from public school teachers’ 
reports about the frequency of sending fourth-grade students to the library. 

• In 1994, almost all of the students in Montana (91 percent) had reading 
teachers who sent or took the class to the library at least once a week. 

This percentage was not significantly different from that of students in 
the nation whose teachers sent or took the class to the library with the 
same frequency (86 percent). 
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TABLE 6.6 

Public School Teachers’ Reports on Sending Students 
to the Library 




The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). Percentages may not add to 100 because a very small percentage of teachers 
reported that there was no library at their school. ! Interpret with caution — the nature of the sample does not allow 
accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 



46 R.C. Anderson, E.H. Hiebert, J.A. Scott, and I.A.G. Wilkinson. Becoming a Nation of Readers: The Report of the 
Commission on Reading. (U.S. Department of Education: The National Institute of Education, 1985). 

K.C. Lance, L. Welbom, and C. Hamilton-Pennel. The Impact of School Library Media Centers on Academic 
Achievement. (Castle Rock, CO: Hi Willow Research and Publishing, 1993). 
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Table 6.7 provides the results about public school teachers’ reports on the 
frequency of assigning students to read a book from the library. 

• In 1994, more than half of the fourth graders in Montana (58 percent) 
had reading teachers who assigned reading a book from the library at 
least once a week. The percentage of students whose teachers assigned 
reading library books this often was smaller across the nation 
(47 percent). 



THE NATIONS 


REPORT 

CARD 


rcai 




; 











TABLE 6.7 

Public School Teachers’ Reports on Assigning Books 
from the Library 



1994 Trial State Assessment 


Montana 


West 


Nation 


How often do you assign 
students to read a book from 
the library? 

At least once a week 
1994 

Once or twice a month 
1994 

Never or hardly ever 
1994 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). Percentages may not add to 100 because a very small percentage of teachers 
reported that there was no library at their school. 
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Assessing Progress in Reading 



Ten years ago, the authors of Becoming a Nation of Readers argued that 
standardized tests do not always provide a deep assessment of reading comprehension 
and should be supplemented with observations of reading fluency, critical analysis of 
lengthy reading selections, and measures of the amount of independent reading and 
writing done by children. 48 

Over the last decade, reforms in classroom assessment have been called for at 
numerous levels. Many educators have begun to utilize assessment methods that are 
more instructionally-relevant and performance based. 49 At the same time, policy makers 
and the interested public have called for educational assessments that measure the more 
integrative, complex abilities that are associated with advanced achievement. 50 

Fourth-grade students’ reading teachers were asked a series of questions to report 
on how often they used different types of assessment measures — including 
multiple-choice tests, longer extended constructed-response questions, and reading 
portfolios — to assess student progress in reading. The use of reading portfolios 51 is 
an emerging assessment technique that may not be widely used in many schools. From 



• In 1994, a small percentage of the fourth-grade public school students 
in Montana (7 percent) were assessed with multiple-choice tests once 
or twice a week. This figure was not significantly different from that 
for the nation, where 12 percent of the students were similarly assessed. 

• The percentage of students in Montana public schools in 1994 who were 
asked to write paragraphs about what they had read once or twice a 
week (36 percent) was not significantly different from that of students 
across the nation (39 percent). 

• In 1994, about one fifth of the fourth graders in public schools in 
Montana (19 percent) were assessed by using reading portfolios once 
or twice a week. This percentage was not significantly different from 
that of students across the nation (15 percent). 



48 R.C. Anderson, E.H. Hiebert, J.A. Scott, and I.A.G. Wilkinson. Becoming a Nation of Readers: The Report of the 
Commission on Reading . (U.S. Department of Education: The National Institute of Education, 1985). 

49 S.W. Valencia, E.H. Hiebert, and P.P. Afflerbach, Eds.. Authentic Reading Assessment: Practices and Possibilities. 
(Newark, DE: International Reading Association, 1994). 

50 G. Wiggins. “Assessment: Authenticity, Context, and Validity,” in Phi Delta Kappan. (November, 1993). pp. 
200-214. 

51 S.W. Valencia, E.H. Hiebert, and P.P. Afflerbach, Eds.. Authentic Reading Assessment: Practices and Possibilities. 
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TABLE 6.8 

Public School Teachers ’ Reports on Assessing 
Progress in Reading 



1994 Trial State Assessment 


Montana 


West Nation 


How often do you use each of the 
following to assess student 
progress in reading? 

Multiple-choice tests 
Once or twice a week 1994 

Once or twice a month 1 994 

Once or twice a year 1994 

Never or hardly ever 1994 

Paragraph length written responses 
about what students have read 
Once or twice a week 1994 

Once or twice a month 1 994 

Once or twice a year 1994 

Never or hardly ever 1994 

Reading portfolios 
Once or twice a week 1994 

Once or twice a month 1 994 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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CHAPTER 7 



Who Is Teaching Reading to Fourth Graders? 

Preparation and Experience 

Many states have begun to raise teacher certification standards and strengthen 
teacher training programs. In curriculum areas requiring special attention and 
improvement, such as reading, it is particularly important to have well-qualified teachers. 
To provide information about the staff who are teaching reading to fourth-grade students, 
the Trial State Assessment Program gathered details on the educational backgrounds of 
the teachers of the assessed students. Table 7.1 summarizes fourth-grade public school 
teachers’ responses to questions concerning their academic preparation, certification, and 
their years of elementary or secondary teaching experience. In 1994: 

• The percentage of students who were being taught by reading teachers 
who reported having at least a master’s or education specialist’s degree 
in Montana (28 percent) was smaller than that for the nation 
(41 percent). 

• About half of the students (49 percent) had reading teachers who had 
the highest level of teaching certification that is recognized by Montana. 

This was smaller than the figure for the nation, where 65 percent of the 
students were taught by reading teachers who were certified at the 
highest level available in their states. 

• In Montana, 24 percent of the students were being taught reading by 
teachers who had an undergraduate major in English, reading, and/or 
language arts. This was not significantly different from the percentage 
of students across the nation who were being taught by reading teachers 
with the same major (20 percent). 

• The percentage of students in Montana who were taught reading by 
teachers who had a graduate major in English, reading, and/or language 
arts (20 percent) was greater than that of students across the nation 
(13 percent). 

• The percentage of students who were being taught reading by teachers 
who have taught at either the elementary or secondary level for at least 
11 years (including part-time teaching) in Montana (75 percent) was 
higher than that for students across the nation (67 percent). 
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TABLE 7.1 

Public School Teachers’ Reports on Their Fields of 
Study and Teaching Experience 



1994 Trial State Assessment 



Montana 



West 



Nation 



What is the highest academic degree you hold? 

Bachelor’s degree 1994 

Master’s or specialist’s degree 1994 

Doctorate or professional degree 1994 

What type of teaching certification do you have 
that is recognized by Montana? 

None, temporary, probational, 

provisional, or emergency 1994 

Regular certification but less 

than the highest available 1994 

Highest certification available 1994 

What was your undergraduate major? 

English, reading, and/or language arts 1994 

Education 1994 

Other 1994 

What was your graduate major? 

English, reading, and/or language arts 1994 

Education 1994 

Other or no graduate level of study 1 994 

How many years in total have you taught at 
either the elementary or secondary level? 

2 years or less 1 994 

3-5 years 1994 

6-10 years 1994 

11-24 years 1994 

25 years or more 1 994 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 
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Professional Development 

Teachers were also asked about the amount of time they spent in staff development 
workshops or seminars dedicated to reading or the teaching of reading during the year 
immediately preceding the Trial State Assessment Program. From Table 7.2, in 1994: 

• In Montana, 33 percent of the fourth-grade public school students had 
reading teachers who spent at least 16 hours in staff development 
workshops or seminars dedicated to reading or the teaching of reading. 

This figure did not differ significantly from that for the nation 
(36 percent). 

• The percentage of students in Montana public schools whose reading 
teachers spent no time on staff development workshops or seminars in 
reading or the teaching of reading (4 percent) was lower than that of 
students across the nation (10 percent). 
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TABLE 7.2 

Public School Teachers 9 Reports on Time Spent in 
Staff Development Workshops and Seminars 



1994 Trial State Assessment 


Montana 


West 


Nation 


During the last year, how much 
time in total have you spent in 
staff development workshops 
or seminars in reading or the 
teaching of reading? 

None 

1994 

One to 15 hours 

1994 

16 hours or more 

1994 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 
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Finally, teachers were asked to report on whether they had training in specific 
aspects of reading during the past five years, either in college courses or through 
workshops. As indicated in Table 7.3, regarding fourth-grade public school students in 
1994: 

• In Montana, 79 percent of the students had reading teachers who 
reported that they had training in teaching critical thinking skills. This 
was not significantly different from the figure for the nation, where 
78 percent of the students had teachers who reported having such 
training. 

• A large majority of the students in Montana (88 percent) had reading 
teachers who reported that they had training in combining reading and 
writing. This percentage was not significantly different from that for 
students across the nation (89 percent). 

• A large majority of the students in Montana (87 percent) had teachers 
who reported having training in the whole language approach to teaching 
reading. This percentage did not differ significantly from that for the 
nation (85 percent). 

• In Montana, 75 percent of the students had teachers who reported that 
they had training in reading assessment. This figure was not 
significantly different from* that for students across the nation, where 
67 percent of the students had teachers who had training in reading 
assessment. 
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TABLE 7.3 

Public School Teachers’ Reports on Training in 
Specific Reading Areas 



1994 Trial State Assessment 


Montana 


West Nation 


During the past five years , have 
you ever had training in any of 
the following? 

Teaching critical thinking 
1994 

Combining reading and writing 

1994 

The whole language approach 
to teaching reading 
1994 

Reading assessment 
1994 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 



* Although the difference may appear large, recall thal 
Appendix A for further discussion.) 
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lificance” here refers to “statistical significance.” (See 
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CHAPTER 8 



Students’ Home Support for Literacy 



A multitude of home and attitudinal variables may affect students’ reading 
achievement. 52 In addition, good readers usually interact with a wide variety of 
materials on their own, and share their experiences with family and friends. 53 Thus, it 
is important to understand students’ attitudes toward reading, the extent to which 
students read on their own, and the degree of home support that is available for reading. 
To examine these factors, students participating in the Trial State Assessment Program 
were asked a series of questions about themselves, their parents or guardians, and home 
factors related to reading. 



Because of the increasing concern for students’ independent reading 
habits, 54 students participating in the Trial State Assessment Program were asked to 
report on how often they read for fun on their own time (Table 8.1). They also were 
asked about the number of books they have read on their own outside of school during 
the month preceding the assessment (Table 8.2), and how often they have taken books 
out of the school libraiy or public library for their own enjoyment (Table 8.3). 



5 " J.T. Guthrie and V. Greaney. “Literacy Acts.” in R. Barr, M. Kamil, P. Mosenthal, and P.D. Pearson, Eds., Handbook 
of Reading Research: Volume //. (New York, NY; Longman, 1991). 

53 A.P. Sweet. Transforming Ideas for Teaching and Learning to Read . (Washington, DC: Office of Educational 
Research and Improvement, 1993). 

54 

L.G. Fielding, P.T. Wilson, and R.C. Anderson. “A New Focus on Free Reading: The Role of Trade Books in Reading 
and Instruction,” in T. Raphael and R. Reynolds, Eds., Contexts of Literacy. (New York: Longman, 1990). 



Reading Outside of School 
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The results are provided in Table 8.1 regarding how often fourth-grade public 
school students reported reading for fun on their own time. 

• In 1994, 49 percent of the students in Montana reported that they read 
for fun almost every day. This figure was somewhat higher than that 
for the nation (45 percent). 

• In Montana in 1994, the average reading proficiency of students who 
read for fun almost every day (230) was higher than that of students 
who reported that they read for fun once or twice a month or less (211). 
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TABLE 8.1 

Public School Students 9 Reports on the Frequency of 
Reading for Fun 



1994 Trial State Assessment 





Montana 


West 


Nation 


How often do you read for fun 
on your own time? 

Almost every day 

1994 

Once or twice a week 
1994 

Once or twice a month 

1994 

Never or hardly ever 
1994 


y. ;;: C7 "Per 
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45 ( 0.7) 
3K0.7, 

1 

12(05) 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 
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Concerning how many books were read by fourth-grade public school students in 
Montana, Table 8.2 reveals that: 

• Less than half of the Montana students in 1994 (38 percent) read five 
or more books on their own outside of school in the month preceding 
the assessment. This figure was somewhat smaller than that of students 
across the nation, where 42 percent of the students reported reading the 
same number of books. 

• In 1994 in Montana, average reading proficiency was lowest for students 
who read no books on their own outside of school during the month 
prior to the assessment. 



THE NATION’S 
REPORT 



CARD 



rae p 




TABLE 8.2 

Public School Students’ Reports on the Number of 
Books Read Outside of School in the Past Month 



1994 Trial Stale Assessment 


Montana 


West 


Nation 


During the past month, how 
many books have you read on 
your own outside of school? 

None 

1994 

One or two 

1994 

Three or four 
1994 

Five or more 
1994 


Per 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 
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Finally, regarding the frequency with which students took books out of the school 
library or public library for their own enjoyment, from Table 8.3: 

• In Montana in 1994, 66 percent of the fourth-grade public school 
students took books out of the library for their own enjoyment at least 
once a week. This percentage was somewhat greater than that for the 
nation (63 percent). 

• In 1994, public school fourth graders in Montana who took books out 
of the library at least once a week had an average reading proficiency 
(227) that was higher than that of students who never or hardly ever took 
books out of the library for their own enjoyment (208). 
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TABLE 8.3 

Public School Students ’ Reports on the Frequency of 
Taking Books Out of the Library 



1994 Trial State Assessment 


Montana 


West Nation 


How often do you take books 
out of the school library or 
public library for your own 
enjoyment? 

Almost every day 
1994 

Once or twice a week 
1994 

Once or twice a month 
1994 

Never or hardly ever 
1994 


Per 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 
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Reading in the Home 

The presence of parents or siblings who model and share reading and the 
availability of reading materials in the home are critical factors in the development of 
students’ appreciation of reading and, ultimately, their comprehension and fluency. 55 
Students participating in the Trial State Assessment Program were asked about the 
availability of newspapers, magazines, books, and an encyclopedia at home. They were 
also asked about the frequency with which they discussed things they had read with 
friends and family. 

Average reading proficiency associated with having zero to two, three, or four of 
these types of materials in the home is shown in Table 8.4. The data for public school 
fourth-grade students in 1994 reveal that: 

• In Montana, 36 percent of the students reported having all four of these 
types of materials in the home. This figure was not significantly 
different from that for the nation (36 percent). 

• Students in Montana who had all four of these types of materials in the 
home showed an average reading proficiency (231) that was higher than 
that of students with zero to two types of materials (213). 



TABLE 8.4 

Public School Students 9 Reports on Types of Reading 
Materials in the Home 



Does your family have , or receive on a 
regular basis , any of the following items: 
more than 25 books , an encyclopedia , 
newspapers , magazines? 

Zero to two types 
1994 

Three types 
1994 

Four types 
1994 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 
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55 L.C. Moll. “Literary Research in Community and Classrooms: A Sociocultural Approach,” in B.D. Ruddell and H. 
Singer, Eds.. Theoretical Models of Reading. (Newark, DE: International Reading Association, 1994). pp. 179-207; 
B. Rogoff. Apprenticeship in Thinking. (New York, NY: Oxford University Press, 1990); D. Taylor. Family Literacy: 
Young Children Learning to Read and Write. (Exeter, NH: Heinemann Educational Books, 1983). 
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Regarding the frequency with which fourth-grade public school students discuss 
what they read with friends and family. Table 8.5 shows that: 

• In 1 994 in Montana, 25 percent of the students discussed with friends 
or family what they read almost every day. This percentage was 
somewhat smaller than that of students across the nation (28 percent). 

• In 1 994, the proficiency of students in Montana who discussed what they 
read with friends or family almost every day (223) was higher than that 
of students that had discussions with friends or family less than weekly 
(218). 
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TABLE 8.5 

Public School Students’ Reports on Talking With 
Friends and Family About Reading 



1994 Trial State Assessment 


Montana 


West 


Nation 


How often do you talk with 
your friends or family about 
something you have read? 

Almost every day 
1994 

Once or twice a week 
1994 

Less than weekly 
1994 


-''' s '-P^i 

BiiSSSH 

223 ( 2-9 
kmc 1.1)': 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 
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Hours of Television Watched Per Day 

Many avid student readers watch a lot of television, while other children neither 
watch much television nor read. 56 However, despite these findings, it is generally 
believed that television viewing has an effect on time given to reading — frequent 
television viewing limits the amount of time available for other activities such as 
reading. 57 Students participating in the Trial State Assessment Program were asked to 
report on the amount of television they watched each day. Table 8.6 shows that, in 
Montana public schools in 1994: 

• Relatively few of the fourth-grade students (12 percent) watched six 
hours or more of television each day. This was smaller than the figure 
for the nation, where 22 percent of the students watched this much 
television. 

• Average reading proficiency in Montana was lowest for students who 
spent six hours or more watching television each day. 
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TABLE 8.6 

Public School Students’ Reports on the Amount of 
Time Spent Watching Television Each Day 



1994 Trial State Assessment 


Montana 


West 


Nation 


How much television do you 
usually watch each day? 

One hour or less 
1994 

Two hours 

1994 

Three hours 
1994 

Four to five hours 
1994 

Six hours or more 
1994 


Per 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 



56 S. Neuman. “The Home Environment and Fifth-grade Students’ Leisure Reading,” in Elementary School Journal , 
83. (1986). pp. 333-343. 

P. Heather. Young People's Reading: A Study of the Leisure Reading of 13-15 Year Olds. (Sheffield, England: 
University of Sheffield, Center for Research on User Studies, 1981). 
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APPENDIX A 



Procedural Appendix 

f .I/ his appendix provides an overview of the technical details of the 1994 Trial 
State Assessment Program in reading. It includes a discussion of the history of NAEP, 
the assessment design, the reading framework and objectives upon which the assessment 
was based, and the procedures used to analyze the results. 

A Recent History of NAEP 

The National Assessment of Educational Progress (NAEP) is a congressionally 
mandated project of the National Center for Education Statistics (NCES) that has 
collected and reported information since 1 969 on what American students know and 
what they can do. It is the nation’s only ongoing, comparable, and representative 
assessment of student achievement. Its assessments are given to representative samples 
of youths attending both public and non-public schools and enrolled in grades 4, 8, 
and 12. 

In 1988, Congress authorized a new aspect of NAEP that allowed states and 
territories to participate voluntarily in a trial state assessment, using samples 
representative of their own students, to provide state-level data comparable to the nation 
and each of the other participating jurisdictions. Pursuant to that law, in 1990, the 
mathematics achievement of public school eighth graders was assessed in 40 
jurisdictions (states, territories, and the District of Columbia). The results were reported 
in The State of Mathematics Achievement: NAEP’s 1990 Assessment of the Nation and 
the Trial Assessment of the States (Washington, DC: National Center for Education 
Statistics, 1991). In 1992, the mathematics achievement of fourth- and eighth-grade 
public school students and the reading achievement of fourth-grade public school 
students were assessed in 44 jurisdictions. The results of these assessments were 
reported in NAEP 1992 Mathematics Report Card for the Nation and the States 
(Washington, DC: National Center for Education Statistics, 1993) and NAEP 1992 
Reading Report Card for the Nation and the States (Washington, DC: National Center 
for Education Statistics,. 1993). 



O 

ERIC 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



91 



89 



Montana 



For the 1994 Trial State Assessment Program, the reading achievement of 
fourth-grade students was again assessed in 44 jurisdictions. Forty jurisdictions involved 
in the 1992 assessment were also involved in the 1994 assessment. The results for 
Montana are reported in this document. 

A difference between the 1994 Trial State Assessment and previous Trial State 
Assessments is the addition of samples of non-public school students, in addition to the 
public school student samples. The purpose of this addition is to provide overall 
state-level data for each jurisdiction that is more easily comparable to overall state-level 
data for the other participating jurisdictions. 

Over time there have been many changes in emphasis of NAEP assessment and 
reporting, both to take advantage of new technologies and to reflect changing trends in 
education. In 1984, a new technology called Item Response Theory (IRT) made it 
possible to create “scale scores” for NAEP similar to those the public was accustomed 
to seeing for the annual Scholastic Achievement Test (SAT). The 1992 reading reports 
marked NCES’s continued attempt to shift to standards-based reporting. The transition 
was made to report NAEP results by “achievement levels.” Achievement levels describe 
how students should perform relative to a body of content reflected in the NAEP 
frameworks (i.e., how much students should know). The impetus for this shift was 
grounded in the belief that NAEP data would take on more meaning for the public if they 
show what proportion of our youth are able to meet standards of performance necessary 
for a changing world. The 1994 report continues to use the achievement levels initially 
implemented in 1992. 

Assessment Content 

The objectives for the 1992 and 1994 assessments were developed through a 
consensus process managed by the Council of Chief State School Officers, and the items 
were developed through a similar process managed by Educational Testing Service. The 
development of the Trial State Assessment Program benefited from the involvement of 
hundreds of representatives from State Education Agencies who attended numerous 
NETWORK meetings; served on committees; reviewed the framework, objectives, and 
questions; and, in general, provided important suggestions on all aspects of the program. 

The reading assessment framework was a four-by-three matrix specifying four 
reading stances — Initial Understanding, Developing an Interpretation, Personal 
Reflection and Response, and Demonstrating a Critical Stance — and three reading 
purposes — reading for literary experience, reading to be informed, and reading to 
perform a task. However, the reading to perform a task category was not evaluated or 
reported for grade 4. Figures A.l and A.2 describe the reading purposes and stances. 
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FIGURE A.1 

Description of Reading Purposes 

Reading involves an interaction between a specific type of text or written material and 
a reader who has a purpose for reading that is related to the type of text and the context 
of the reading situation. The 1992 and 1994 NAEP reading assessments presented three 
types of text to students representing each of three reading purposes: literary text for 
literary experience, informational text to gain information, and documents to perform a 
task. At grade 4, only the first two reading purposes were assessed. Each block in the 
assessment contains questions that assess only one reading purpose. 
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Reading for Literary Experience 



Reading for literary experience involves reading literary text to explore the human 
condition, to relate narrative events with personal experience, and to consider the 
interplay in the selection among emotions, events, and possibilities. Students in the 
NAEP reading assessment were provided with a wide variety of literary texts such as 
short stories, poems, fables, historical fiction, science fiction, and mysteries. 



Reading to Gain Information : 



Reading to gain information involves reading informative passages in order to obtain 
some general or specific information. This often requires a more utilitarian approach 
to reading that requires the use of certain reading/thinking strategies different from 
those used for other purposes. In addition, reading to gain information often involves 
reading and interpreting adjunct aids such as charts, graphs, maps, and tables that 
provide supplemental or tangential data. Informational passages in the NAEP reading 
assessment included biographies, science articles, encyclopedia entries, primary and 
secondary historical accounts, and newspaper editorials. 



Reading to Perform a Task 



Reading to perform a task involves reading various types of materials for the purpose 
of applying the information or directions in completing a specific task. The reader’s 
purpose for gaining meaning extends beyond understanding the text to include the 
accomplishment of a certain activity. Documents requiring students in the NAEP 
reading assessment to perform a task included directions for creating a time capsule, 
instructions on how to write a letter to your Senator, a bus schedule, and a tax form. 
In 1992 and 1994, reading to perform a task was assessed only at grades 8 and 12. 
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FIGURE A.2 

Description of Reading Stances 

Readers interact with text in various ways as they use background knowledge and 
understanding of text to construct, extend, and examine meaning. The NAEP reading 
assessment framework specified four reading stances to be assessed that represent 
various interactions between readers and texts. These stances are not meant to describe 
a hierarchy of skills or abilities. Rather, they are intended to describe behaviors that 
readers at all developmental levels should exhibit. 

Initial Understanding 

Initial understanding requires a broad, preliminary construction of an understanding 
of the text. Questions testing this aspect ask the reader to provide an initial 
impression or unreflected understanding of what was read. In the 1992 and 1994 
NAEP reading assessments, the first question following a passage was usually one 
testing initial understanding. 
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Developing an Interpretation 



Developing an interpretation requires the reader to go beyond the initial impression 
to develop a more complete understanding of what was read. Questions testing this 
aspect require a more specific understanding of the text and involve linking 
information across parts of the text as well as focusing on specific information. 



Personal Reflection and Response : 



Personal response requires the reader to connect knowledge from the text more 
extensively with his or her own personal background knowledge and experience. The 
focus is on how the text relates to personal experience, and questions on this aspect 
ask the readers to reflect and respond from a personal perspective. For the 1992 and 
1994 NAEP reading assessments, personal response questions were typically 
formatted as constructed-response items to allow for individual possibilities and varied 
responses. 



Demonstrating a Critical Stance 



Demonstrating a critical stance requires the reader to stand apart from the text, 
consider it, and judge it objectively. Questions on this aspect require the reader to 
perform a variety of tasks such as critical evaluation, comparing and contrasting, 
applications to practical tasks, and understanding the impact of such text features as 
irony, humor, and organization. These questions focus on the reader as critic and 
require reflection on and judgments about how the text is written. 
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Assessment Design 

The 1994 reading assessment was based on a focused balanced incomplete block 
(BIB) spiral matrix design — a design that enables broad coverage of reading content 
while minimizing the burden for any one student. The 1994 NAEP reading assessment 
for grades 4, 8, and 12 contained a total of 153 discrete constructed-response questions 

— 126 of which were short constructed-response (78 scored using a two-point scoring 
rubric and 48 using a three-point scoring rubric), and 27 of which were extended 
constructed-response questions (scored using a four-point scoring rubric). Some of the 
questions in the assessment were administered at more than one grade. Therefore, the 
sum of the number of questions administered at each grade does not equal the total 
number of questions in the assessment. 

At grade 4, 84 reading questions were developed for the national assessment, 
including 37 short constructed-response questions, eight extended constructed-response 
questions, and 39 multiple-choice questions. These same questions were administered 
to the Trial State Assessment samples of grade 4 students. A subset of the grade 4 
exercise pool consisted of questions that were previously administered in 1992. These 
“trend” questions made it possible to report the 1992 and 1994 results on a common 
scale. 

The first step in implementing the BIB design required selecting grade-appropriate 
passages and developing questions to assess the four reading stances specified in the 
framework. The questions were assembled into units called blocks , with each block 
designed to be completed in 25 or 50 minutes. At grade 4, eight blocks were designed; 
they required 25 minutes of student time for completion. The blocks were assembled 
into assessment booklets so that each booklet contained three background questionnaires 

— the first consisting of general background questions, the second comprising reading 
background questions, and the third containing questions about the students’ motivation 
to do well in the assessment — and two blocks of cognitive reading questions. The 
questions in the first section were read aloud to the students, usually taking about 10 
minutes to complete. Students were then given 50 minutes to complete two 25-minute 
blocks of reading questions, five minutes to complete the second background 
questionnaire, and three minutes to complete the third background questionnaire. Thus, 
the assessment required slightly over one hour of student time. 

In accordance with the BIB design, the blocks were assigned to the assessment 
booklets so that there were a total of 16 booklets at grade 4. Blocks of cognitive reading 
questions were paired with blocks assessing the same purpose for reading as well as 
blocks assessing other purposes. (Readers should refer to the 1994 NAEP State 
Technical Report for a more complete discussion of the BIB design.) The booklets were 
spiraled or interleaved in a systematic sequence so that each booklet appeared an 
appropriate number of times in the sample. The students within an assessment session 
were assigned booklets in the order in which the booklets were spiraled. Thus, students 
in any given session received a variety of different booklets and only a small number 
of students in the session received the same booklet. 
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Participation Guidelines 

Unless the overall participation rate is sufficiently high for a jurisdiction, there is 
a risk that the assessment results for that jurisdiction are subject to appreciable 
nonresponse bias. Moreover, even if the overall participation rate is high, there may 
be significant nonresponse bias if the nonparticipation that does occur is heavily 
concentrated among certain types of schools or students. The following guidelines 
concerning school and student participation rates in the Trial State Assessment Program 
were established to address four significant ways in which nonresponse bias could be 
introduced into the jurisdiction sample estimates. The conditions that will result in the 
publication of a jurisdiction’s results are presented below. Also presented below are the 
conditions that will result in a jurisdiction receiving a notation in the 1994 reports. Note 
that in order for a jurisdiction’s results to be published with no notations, that jurisdiction 
must satisfy all guidelines. 

Guidelines on the Publication of NAEP Results 



Guideline 1 — Publication of Public School Results 
A jurisdiction will have its public school results published in the 1994 
NAEP Reading Report Card if and only if its weighted participation rate 
for the initial sample of public schools is greater than or equal to 70 
percent. Similarly, a jurisdiction will receive a separate NAEP State 
Report if and only if its weighted participation rate for the initial sample 
of public schools is greater than or equal to 70 percent. 

Guideline 2 — Publication of Non-Public School Results 
A jurisdiction will have its non-public school results published in the 
1994 NAEP Reading Report Card if and only if its weighted 
participation rate for the initial sample of non-public schools is greater 
than or equal to 70 percent AND meets minimum sample size 
requirements. 1 A jurisdiction eligible to receive a separate NAEP State 
Report under guideline 1 will have its non-public school results included 
in that report if and only if that jurisdiction’s weighted participation rate 
for the initial sample of non-public schools is greater than or equal to 
70 percent AND meets minimum sample size requirements. If a 
jurisdiction meets guideline 2 but fails to meet guideline 1, a separate 
NAEP State Report will be produced containing only non-public school 
results. 

Guideline 3 — Publication of Combined Public and Non-Public 

School Results 

A jurisdiction will have its combined results published in the 1994 
NAEP Reading Report Card if and only if both guidelines 1 and 2 are 
satisfied. Similarly, a jurisdiction eligible to receive a separate NAEP 
State Report under guideline 1 will have its combined results included 
in that report if and only if guideline 2 is also met. 
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Discussion: If a jurisdiction’s public or non-public school participation rate for 
the initial sample of schools is below 70 percent there is a substantial possibility that 
bias will be introduced into the assessment results. This possibility remains even after 
making statistical adjustments to compensate for school nonparticipation. There remains 
the likelihood that, in aggregate, the substitute schools are sufficiently dissimilar from 
the originals that they are replacing and represent too great a proportion of the 
population to discount such a difference. Similarly, the assumptions underlying the use 
of statistical adjustments to compensate for nonparticipation are likely to be significantly 
violated if the initial response rate falls below the 70 percent level. Guidelines 1, 2, 
and 3 take this into consideration. These guidelines are congruent with current NAGB 
policy, which requires that data for jurisdictions that do not have a 70 percent 
before-substitution participation rate be reported “in a different format” and with the 
Education Information Advisory Committee (EIAC) resolution, which calls for data from 
such jurisdictions not to be published. 

Guidelines on Notations of NAEP Results 

Guideline 4 — Notation for Overall Public School Participation Rate 
A jurisdiction which meets guideline 1 will receive a notation if its 
weighted participation rate for the initial sample of public schools was 
below 85 percent AND the weighted public school participation rate 
after substitution was below 90 percent. 

Guideline 5 — Notation for Overall Non-Public School Participation 

Rate 

A jurisdiction which meets guideline 2 will receive a notation if its 
weighted participation rate for the initial sample of non-public schools 
was below 85 percent AND the weighted non-public school participation 
rate after substitution was below 90 percent. 

Discussion: For jurisdictions that did not use substitute schools, the participation 
rates are based on participating schools from the original sample. In these situations, 
the NCES standards specify weighted school participation rates of at least 85 percent to 
guard against potential bias due to school nonresponse. Thus, the first part of these 
guidelines, referring to the weighted school participation rate for the initial sample of 
schools, is in direct accordance with NCES standards. 
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To help ensure adequate sample representation for each jurisdiction participating 
in the 1 994 Trial State Assessment Program, NAEP provided substitutes for 
nonparticipating public and non-public schools. When possible, a substitute school was 
provided for each initially selected school that declined participation before November 
15, 1993. For jurisdictions that used substitute schools, the assessment results will be 
based on the student data from all schools participating from both the original sample 
and the list of substitutes (unless both an initial school and its substitute eventually 
participated, in which case only the data from the initial school will be used). 

The NCES standards do not explicitly address the use of substitute schools to 
replace initially selected schools that decide not to participate in the assessment. 
However, considerable technical consideration was given to this issue. Even though the 
characteristics of the substitute schools were matched as closely as possible to the 
characteristics of the initially selected schools, substitution does not entirely eliminate 
bias due to the nonparticipation of initially selected schools. Thus, for the weighted 
school participation rates including substitute schools, the guidelines were set at 90 
percent. 

If a jurisdiction meets either standard (i.e., 85 percent or higher prior to 
substitution or 90 percent or higher after substitution) then there will be no notation for 
the relevant overall school participation rate. 

Guideline 6 — Notation for Strata-Specific Public School Participation 

Rate 

A jurisdiction which is not already receiving a notation under 

guideline 4 will receive a notation if the nonparticipating public schools 
included a class of schools with similar characteristics, which together 
accounted for more than five percent of the jurisdiction’s total 
fourth-grade weighted sample of public schools. The classes of schools 
from each of which a jurisdiction needed minimum school participation 
levels were determined by degree of urbanization, minority enrollment, 
and median household income of the area in which the school is located. 

Guideline 7 — Notation for Strata-Specific Non-Public School 
Participation Rate 

A jurisdiction which is not already receiving a notation under 

guideline 5 will receive a notation if the nonparticipating non-public 
schools included a class of schools with similar characteristics, which 
together accounted for more than five percent of the jurisdiction’s total 
fourth-grade weighted sample of non-public schools. The classes of 
schools from each of which a jurisdiction needed minimum school 
participation levels were determined by type of non-public school 
(Catholic versus non-Catholic) and location (metropolitan versus 
non-metropolitan) . 
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Discussion: The NCES standards specify that attention should be given to the 
representativeness of the sample coverage. Thus, if some important segment of the 
jurisdiction’s population is not adequately represented, it is of concern, regardless of the 
overall participation rate. 

These guidelines address the fact that, if nonparticipating schools are concentrated 
within a particular class of schools, the potential for substantial bias remains, even if the 
overall level of school participation appears to be satisfactory. Nonresponse adjustment 
cells for public schools have been formed within each jurisdiction, and the schools 
within each cell are similar with respect to minority enrollment, degree of urbanization, 
and/or median household income, as appropriate for each jurisdiction. For non-public 
schools, nonresponse adjustment cells are determined by type and location of school. 

If more than five percent (weighted) of the sampled schools (after substitution) 
are nonparticipants from a single adjustment cell, then the potential for nonresponse bias 
is too great. These guidelines are based on the NCES standard for strata-specific school 
nonresponse rates. 



A jurisdiction which meets guideline 1 will receive a notation if the 
weighted student response rate within participating public schools was 
below 85 percent. 

Guideline 9 — Notation for Overall Student Participation Rate in 
Non-Public Schools 

A jurisdiction which meets guideline 2 will receive a notation if the 
weighted student response rate within participating non-public schools 
was below 85 percent. 

Discussion: These guidelines follow the NCES standard of 85 percent for overall 
student participation rates. The weighted student participation rate is based on all 
eligible students from initially selected or substitute schools who participated in the 
assessment in either an initial session or a make-up session. If the rate falls below 
85 percent, then the potential for bias due to students’ nonresponse is too great. 



A jurisdiction which is not already receiving a notation under 
guideline 8 will receive a notation if the nonresponding students within 
participating public schools included a class of students with similar 
characteristics, who together comprised more than five percent of the 
jurisdiction’s weighted assessable public school student sample. Student 
groups from which a jurisdiction needed minimum levels of participation 
were determined by age of student and type of assessment session 
(unmonitored or monitored), as well as school level of urbanization, 
minority enrollment, and median household income of the area in which 
the school is located. 



Guideline 8 — Notation for Overall Student Participation Rate in 

Public Schools 



Guideline 10 — Notation for Strata-Specific Student Participation 
Rate in Public Schools 
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Guideline 11 — Notation for Strata-Specific Student Participation 
Rate in Non-Public Schools 



A jurisdiction which is not already receiving a notation under 
guideline 9 will receive a notation if the nonresponding students within 
participating non-public schools included a class of students with similar 
characteristics, who together comprised more than five percent of the 
jurisdiction’s weighted assessable non-public school student sample. 

Student groups from which a jurisdiction needed minimum levels of 
participation were determined by age of student and type of assessment 
session (unmonitored or monitored), as well as type and location of 
school. 

Discussion: These guidelines address the fact that if nonparticipating students are 
concentrated within a particular class of students, the potential for substantial bias 
remains, even if the overall student participation level appears to be satisfactory. Student 
nonresponse adjustment cells have been formed using the school-level nonresponse 
adjustment cells, together with the student’s age and the nature of the assessment session 
(unmonitored or monitored). If more than five percent (weighted) of the invited students 
who do not participate in the assessment are from a single adjustment cell, then the 
potential for nonresponse bias is too great. These guidelines are based on the NCES 
standard for strata-specific student nonresponse rates. 

Data Analysis and Scales 

Once the assessments were conducted and information from the assessment 
booklets had been compiled in a database, the assessment data were weighted to match 
known population proportions and adjusted for nonresponse. Analyses were then 
conducted to determine the percentages of students who gave various responses to each 
cognitive and background question. 

For both the 1992 and 1994 assessments, item response theory (IRT) was used to 
estimate average reading proficiency for each jurisdiction and for various 
subpopulations, based on students’ performance on the set of reading questions they 
received. IRT provides a common scale on which performance can be reported for the 
nation, each jurisdiction, and subpopulations, even when all students do not answer the 
same set of questions. Furthermore, these IRT scales provide a mechanism for 
comparing the reading results obtained in 1994 with those from 1992 even though there 
were some differences between the sets of questions that were administered in the two 
assessment years. This common scale makes it possible to report on relationships 
between students’ characteristics (based on their responses to the background questions) 
and their overall performance on the assessment. 
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The results from the 1 994 assessment are reported on scales ranging from 0 to 500 
that were created to summarize performance for each of the two reading purposes at 
grade 4 (reading for literary experience and reading to gain information). The scales 
summarize examinee performance across all four question types used in the assessment 
(multiple-choice, dichotomously-scored constructed-response, regular 
constructed-response, and extended constructed-response). In producing the scales, three 
distinct IRT models were used. Multiple-choice questions were scaled using the 
three-parameter logistic model; dichotomously-scored constructed-response questions 
were scaled using the two-parameter logistic model; the regular and extended 
constructed-response questions were scaled using a generalized partial-credit model. 
Each reading purpose scale was based on the distribution of student performance across 
the grades assessed in the 1992 national assessment (grades 4, 8, and 12) and had a mean 
of 250 and a standard deviation of 50 for that reference population. A composite scale 
was created as an overall measure of students’ reading proficiency. At grade 4, the 
composite scale was a weighted average of the two reading purpose scales, where the 
weight for each reading purpose was proportional to the relative importance assigned to 
that purpose in the specifications developed by the Reading Objectives Panel (55 percent 
for the literary experience scale and 45 percent for the gaining information scale). 

Questionnaires for Teachers and Schools 

As part of the Trial State Assessment Program, questionnaires were given to the 
reading teachers of assessed students and to the principal or other administrator in each 
participating school. A Background Panel drafted a set of issues and guidelines and 
made recommendations concerning the design of these questionnaires. For the 1992 and 
1994 assessments, the teacher and school questionnaires focused on five educational 
areas: instructional content, instructional practices and experiences, teacher 
characteristics, school conditions and context, and conditions beyond school (i.e., home 
support, out-of-school activities, and attitudes). Similar to the development of the 
materials given to students, the guidelines and the teacher and school questionnaires 
were prepared through an iterative process that involved extensive development, field 
testing, and review by external advisory groups. 

It is important to note that in this report, as in all NAEP reports, the student is 
always the unit of analysis, even when information from the teacher or school 
questionnaire is being reported. Having the student as the unit of analysis makes it 
possible to describe the instruction received by representative samples of fourth-grade 
students. Although this approach may provide a different perspective from that which 
would be obtained by simply collecting information from a sample of fourth-grade 
reading teachers or from a sample of schools, it is consistent with NAEP’s goal of 
providing information about the educational context and performance of students. 
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The questionnaires for fourth-grade teachers consisted of two parts. The first 
requested information about the teacher, such as race/ethnicity and gender, as well as 
academic degrees held, teaching certification, training in reading, and. the availability 
of instructional resources. In the second part, teachers were asked to provide 
information on each class they taught that included one or more students who 
participated in the Trial State Assessment Program. The information included, among 
other things, the extent to which worksheets or workbooks were used and the frequency 
with which various instructional approaches were employed. Because of the nature of 
the sampling for the Trial State Assessment Program, the responses to the reading 
teacher questionnaire do not necessarily represent all fourth-grade reading teachers in a 
jurisdiction. Rather, they represent the teachers of the particular students being assessed. 

An extensive school questionnaire was completed by principals or other 
administrators in the schools participating in the Trial State Assessment Program. The 
school questionnaire contained questions about school policies, course offerings, and 
special priority areas, among other topics. 

Estimating Variability 

The statistics reported by NAEP (average proficiencies, percentages of students 
at or above particular achievement levels, and percentages of students responding in 
certain ways to background questions) are estimates of the corresponding information 
for the population of fourth-grade students in public or non-public schools in a 
jurisdiction. These estimates are based on the performance of carefully selected, 
representative samples of fourth-grade students from the jurisdiction. 

If a different representative sample of students were selected and the assessment 
repeated, it is likely that the estimates might vary somewhat, and both of these sample 
estimates might differ somewhat from the value of the mean or percentage that would 
be obtained if every fourth-grade public or non-public school student in the jurisdiction 
were assessed. Virtually all statistics that are based on samples (including those in 
NAEP) are subject to a certain degree of uncertainty. The uncertainty attributable to 
using samples of students is referred to as sampling error. 

Like almost all estimates based on assessment measures, NAEP’s total group and 
subgroup performance estimates are subject to a second source of uncertainty, in addition 
to sampling error. As previously noted, each student who participated in the Trial State 
Assessment Program was administered a subset of questions from the total set of 
questions. If each student had been administered a different, but equally appropriate, 
set of the assessment questions — or the entire set of questions — somewhat different 
estimates of total group and subgroup performance might have been obtained. Thus, a 
second source of uncertainty arises because each student was administered a subset of 
the total pool of questions. 
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The measures of uncertainty of the estimates of reading performance statistics 
reflect both sources of uncertainty discussed above. These measures of the uncertainty 
are called standard errors and are given in parentheses in each of the tables in the report. 
Standard errors reflecting both sampling and measurement error are reported for 
estimates of average proficiency and percentage of students at or above particular 
achievement levels. The standard errors of the other statistics (such as the percentage 
of students answering a background question in a certain way or the percentage of 
students in certain racial/ethnic groups) reflect only sampling error. NAEP uses a 
methodology called the jackknife procedure to estimate all of these standard errors. 

The reader is reminded that, as in all surveys, NAEP results are also subject to 
other kinds of errors including the effects of necessarily imperfect adjustment for student 
and school nonresponse and other largely unknowable effects associated with the 
particular instrumentation and data collection methods used. Nonsampling errors can 
be attributed to a number of sources: inability to obtain complete information about all 
selected students in all selected schools in the sample (some students or schools refused 
to participate, or students participated but answered only certain questions); ambiguous 
definitions; differences in interpreting questions; inability or unwillingness to give 
correct information; mistakes in recording, coding, or scoring data; and other errors of 
collecting, processing, sampling, and estimating missing data. The extent of 
nonsampling errors is difficult to estimate. By their nature, the impact of such errors 
cannot be reflected in the data-based estimates of uncertainty provided in NAEP reports. 

Drawing Inferences from the Results 

One of the goals of the Trial State Assessment Program is to make inferences 
about the overall population of fourth-grade students in each participating jurisdiction 
based on the particular sample of students assessed. The results from the sample — 
taking into account the uncertainty associated with all samples — are used to make 
inferences about the population. The use of confidence intervals , based on the standard 
errors, provides a way to make inferences about the population means and percentages 
in a manner that reflects the uncertainty associated with the sample estimates. An 
estimated sample mean proficiency ± 2 standard errors approximates a 95 percent 
confidence interval for the corresponding population quantity. This means that with 
approximately 95 percent confidence, the average performance of the entire population 
of interest (e.g., all fourth-grade students in public schools in a jurisdiction) is within ± 
2 standard errors of the sample mean. 
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As an example, suppose that the average reading proficiency of the students in a 
particular jurisdiction’s fourth-grade sample were 256 with a standard error of 1.2. A 
95 percent confidence interval for the population quantity would be as follows: 

Mean ± 2 standard errors = 256 ± 2 x (1.2) = 256 ± 2.4 = 

256 - 2.4 and 256 + 2.4 = (253.6, 258.4) 

Thus, one can conclude with 95 percent confidence that the average proficiency 
for the entire population of fourth-grade students in public schools in that jurisdiction 
is between 253.6 and 258.4. 

Similar confidence intervals can be constructed for percentages, provided that the 
percentages are not extremely large ( greater than 90 percent ) or extremely small (less 
than 10 percent ). For extreme percentages, confidence intervals constructed in the above 
manner may not be appropriate and procedures for obtaining accurate confidence 
intervals are quite complicated. 

Analvzine Subgroup Differences in Proficiencies and Percentages 

In addition to the overall results, this report presents outcomes separately for a 
variety of important subgroups. Many of these subgroups are defined by shared 
characteristics of students, such as their gender or race/ethnicity, and the type of location 
in which their school is situated. Other subgroups are defined by students’ responses 
to background questions. Still other subgroups are defined by the responses of the 
assessed students’ reading teachers to questions in the reading teacher questionnaire. 

In Chapter 1 of this report, differences between the jurisdiction and nation were 
tested for overall reading proficiency and for each of the purposes for reading. In 
Chapter 2, significance tests were conducted for the overall proficiency for each of the 
subpopulations. Chapter 3 reports differences between the jurisdiction and nation for 
the percentage of students at or above the Proficient level, and Chapter 4 contains 
significance tests for the percentage of students at or above the Proficient level for each 
of the subpopulations. In Chapters 5-8, comparisons were made across subgroups for 
responses made to various background questions. 
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As an example, consider the question: Do students who reported reading three 
or four books outside of school each month exhibit higher average reading proficiency 
than students who reported reading no books outside of school? 

To answer the question posed above, begin by comparing the average reading 
proficiency for the two groups being analyzed. If the mean for the group that reported 
reading three or four books outside of school is higher, it may be tempting to conclude 
that that group does have higher reading proficiency than the group that reported reading 
no books outside of school. However, even though the means differ, there may be no 
real difference in performance between the two groups in the population because of the 
uncertainty associated with the estimated average proficiency of the groups in the 
sample. Remember that the intent is to make a statement about the entire population, 
not about the particular sample that was assessed. The data from the sample are used 
to make inferences about the population as a whole. 

As discussed in the previous section, each estimated sample mean proficiency (or 
percentage) has a degree of uncertainty associated with it. It is therefore possible that 
if all students in the population had been assessed, rather than a sample of students, or 
if the assessment had been repeated with a different sample of students or a different, 
but equivalent, set of questions, the performances of various groups would have been 
different. Thus, to determine whether there is a real difference between the mean 
proficiency (or percentage of a certain attribute) for two groups in the population, an 
estimate of the degree of uncertainty associated with the difference between the 
proficiency means or percentages of those groups must be obtained for the sample. This 
estimate of the degree of uncertainty — called the standard error of the difference 
between the groups — is obtained by taking the square of each group’s standard error, 
summing these squared standard errors, and then taking the square root of this sum. 

Similar to the manner in which the standard error for an individual group mean 
or percentage is used, the standard error of the difference can be used to help determine 
whether differences between groups in the population are real. The difference between 
the mean proficiency or percentage of the two groups ± 2 standard errors of the 
difference represents an approximate 95 percent confidence interval. If the resulting 
interval includes zero, there is insufficient evidence to claim a real difference between 
groups in the population. If the interval does not contain zero, the difference between 
groups is statistically significant (different) at the .05 level. 
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As another example, to determine whether the average reading proficiency of 
fourth-grade females is higher than that of fourth-grade males in a particular 
jurisdiction’s public schools, suppose that the sample estimates of the mean proficiencies 
and standard errors for females and males were as follows: 



Group 


Average Proficiency 


Standard Error 


Female 


259 


2.0 


Male 


255 


2.1 



The difference between the estimates of the mean proficiencies of females and 
males is four points (259 - 255). The standard error of this difference is 

V _ 2.0 2 + 2.1 2 = 2.9 

Thus, an approximate 95 percent confidence interval for this difference is 
Mean difference ± 2 standard errors of the difference = 

4 ± 2 x (2.9) = 4 ± 5.8 = 4 - 5.8 and 4 + 5.8 = (-1.8, 9.8) 

The value zero is within this confidence interval, which extends from -1.8 to 9.8 
(i.e., zero is between -1.8 and 9.8). Thus, there is insufficient evidence to claim a 
difference in average reading proficiency between the populations of fourth-grade 
females and males in public schools in the jurisdiction. 2 

Throughout this report, when the mean proficiencies or percentages for two groups 
were compared, procedures like the one described above were used to draw the 
conclusions that are presented. If a statement appears in the report indicating that a 
particular group had higher (or lower) average proficiency than a second group, the 95 
percent confidence interval for the difference between groups did not contain zero. 
When a statement indicates that the average proficiency or percentage of some attribute 
was not significantly different for two groups, the confidence interval included zero, and 
thus no difference could be assumed between the groups. The information described in 
this section also pertains to comparisons between 1992 and 1994. The reader is 
cautioned to avoid drawing conclusions solely on the basis of the magnitude of the 
differences. A difference between two groups in the sample that appears to be slight 
may represent a statistically significant difference in the population because of the 
magnitude of the standard errors. Conversely, a difference that appears to be large may 
not be statistically significant. 



2 

The procedure described above (especially the estimation of the standard error of the difference) is, in a strict sense, 
only appropriate when the statistics being compared come from independent samples. For certain comparisons in the 
report, the groups were not independent. In those cases, a different (and more appropriate) estimate of the standard 
error of the difference was used. 
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The procedures described in this section, and the certainty ascribed to intervals 
(e.g., a 95 percent confidence interval), are based on statistical theory that assumes that 
only one confidence interval or test of statistical significance is being performed. 
However, in each chapter of this report, many different groups are being compared (i.e., 
multiple sets of confidence intervals are being analyzed). In sets of confidence intervals, 
statistical theory indicates that the certainty associated with the entire set of intervals is 
less than that attributable to each individual comparison from the set. To hold the 
certainty level for the set of comparisons at a particular level (e.g., .95), adjustments 
(called multiple comparison procedures) must be made to the methods described in the 
previous section. One such procedure — the Bonferroni method — was used in the 
analyses described in this report to form confidence intervals for the differences between 
groups whenever sets of comparisons were considered. Thus, the confidence intervals 
in the text that are based on sets of comparisons are more conservative than those 
described on the previous pages. A more detailed description of the use of the 
Bonferroni procedure appears in the 1994 NAEP State Technical Report. 

Statistics with Poorly Estimated Standard Errors 

The standard errors for means and proportions reported by NAEP are statistics and 
therefore are subject to a certain degree of uncertainty. In certain cases, typically when 
the standard error is based on a small number of students, or when the group of students 
is enrolled in a small number of schools, the amount of uncertainty associated with the 
standard errors may be quite large. Throughout this report, estimates of standard errors 
subject to a large degree of uncertainty are followed by the symbol “!”. In such cases, 
the standard errors — and any confidence intervals or significance tests involving these 
standard errors — should be interpreted cautiously. Further details concerning procedures 
for identifying such standard errors are discussed in the 1994 NAEP State Technical 
Report. 

Minimum Subgroup Sample Sizes 

Results for reading performance and background variables were tabulated and 
reported for groups defined by race/ethnicity, type of location, parents’ education level, 
and gender. NAEP collects data for six racial/ethnic subgroups (White, Black, Hispanic, 
Asian, Pacific Islander, and American Indian/Alaskan Native), three types of locations 
(Central City, Urban Fringe/Large Town, and Rural/Small Town), and five levels of 
parents’ education (Graduated College, Some Education After High School, Graduated 
High School, Did Not Finish High School, and I Don’t Know). In the past, NAEP 
collected information for only five racial/ethnic subgroups, with Asian and Pacific 
Islander students combined into one subgroup. In addition, previous NAEP reports 
reported data for four types of communities, rather than for the three types of location. 
These types of communities were Advantaged Urban, Disadvantaged Urban, Extreme 
Rural, and Other types of communities. 
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In many jurisdictions, and for some regions of the country, the number of students 
in some of these groups was not sufficiently high to permit accurate estimation of 
performance and/or background variable results. As a result, data are not provided for 
the subgroups with very small sample sizes or for the subgroups with students from very 
few schools. For results to be reported for any Trial State Assessment Program 
subgroup, at least ten public schools or six non-public schools must be represented in 
the subgroup. For results to be reported for any National Assessment subgroup, at least 
five primary sampling units (PSU’s) must be represented in the subgroup. In addition, 
a minimum sample of 62 students per subgroup was required. For statistical tests 
pertaining to subgroups, the sample size for both groups had to meet the minimum 
sample size requirements. 

The minimum sample size of 62 was determined by computing the sample size 
required to detect an effect size of .5 total-group standard deviation units with a 
probability of .8 or greater. The effect size of .5 pertains to the true difference between 
the average proficiency of the subgroup in question and the average proficiency for the 
total fourth-grade public school population in the jurisdiction, divided by the standard 
deviation of the proficiency in the total population. If the true difference between 
subgroup and total group mean is .5 total-group standard deviation units, then a sample 
size of at least 62 is required to detect such a difference with a probability of .8. Further 
details about the procedure for determining minimum sample size appear in the 1994 
NAEP State Technical Report. 

Describing the Size of Percentages 

Some of the percentages reported in the text of the report are given qualitative 
descriptions. For example, the number of students being taught by teachers with 
master’s degrees in education might be described as “relatively few” or “almost all,” 
depending on the size of the percentage in question. Any convention for choosing 
descriptive terms for the magnitude of percentages is to some degree arbitrary. The 
descriptive phrases used in the report and the rules used to select them are shown on the 
following page. 
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Percentage 


Description of Text in Report 


p = 0 


None 


0 < p < 8 


A small percentage 


8 < p < 13 


Relatively few 


13 < p < 18 


Less than one fifth 


18 < p < 22 


About one fifth 


22 < p < 27 


About one quarter 


27 < p < 30 


Less than one third 


30 < p < 36 


About one third 


36 < p < 47 


Less than half 


47 < p < 53 


About half 


53 < p < 64 


More than half 


64 < p < 71 


About two thirds 


71 < p < 79 


About three quarters 


79 < p < 89 


A large majority 


89 < p < 100 


Almost all 


p = 100 


All 



Revisions to the 1992 and 1994 Findings 

In April 1995, results from the 1994 National and Trial State Assessment of 
reading were released as part of the report NAEP 1994 Reading: A First Look. 
Subsequently, ETS/NAEP discovered an error in the documentation for the ETS program 
used to compute NAEP scale score results. The error affected how omitted responses 
were treated in the IRT scaling of the extended constructed-response questions that 
received partial-credit scoring. The error affected only those questions; omitted 
multiple-choice and omitted short constructed responses were treated appropriately. 

The conventional treatment in NAEP subjects has been to treat omitted responses 
(blank responses to a question that are followed by valid responses to questions that 
appear later in the block) as the lowest possible score category in the production of 
NAEP scale scores. In contrast, not-reached responses (blank responses that are not 
followed by any further student responses) are treated as missing data. As a result of 
the documentation error, for a number of the polytomous constructed-response questions 
and across several subject areas, all blank responses (both omitted and not-reached 
responses) to affected questions were treated as missing — an acceptable treatment but 
not the conventional option of choice for NAEP. 
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The error affected a number of the NAEP scales constructed since 1992. 
Specifically, the 1992 and 1994 national and state reading results were affected by the 
error. Results from these two assessments have been released to the public in a number 
of NAEP publications. The 1992 data are also available to the public through NCES's 
secondary-use data files. 

It should be noted that this processing error also impacted the location of the 
National Assessment Governing Board (NAGB) achievement levels in reading, which 
were set on the 1992 scales. 

NCES and ETS felt that the most technically correct plan of action would be to 
recalculate all affected NAEP scales, no matter how slight the change, and to issue 
revised results. ETS was therefore instructed by NCES to recalculate all affected scales 
and to work with American College Testing (ACT) in the recomputation of the 
achievement level cutpoints. 

In recomputing the cutpoints, an additional error was discovered in the procedures 
used by ACT in 1992 to “map” the achievement level cutpoints onto the NAEP scale. 
The procedures contained an incorrectly derived formula. ACT used revised procedures 
with the correct formula to map the achievement level cutpoints for the 1994 history and 
geography scales. However, the error in the earlier procedures did affect achievement 
level cutpoints for reading, which were established during the 1992 assessment. The 
1992 national and state reading achievement level results were further impacted by this 
additional error. 

A new version of the NAEP 1994 Reading: A First Look report, containing the 
revised reading results, was issued by NCES in the fall of 1995. The main release of 
NAEP reading results, including the Reading Report Card , Cross-state Data 
Compendium , individual state reports, almanacs, technical report, and data files, 
originally scheduled for the end of September, took place instead in late fall. 

While some small changes in scale score results were found, the revised numbers 
for reading are quite similar to the results released in 1992 and to those published in the 
NCES April release of the reading First Look report. More specifically, the revised 
reading results are substantively equivalent to the originally published 1992 results and 
to the results released in the First Look. Regarding the 1992 and 1994 national 
assessment data, fourth-grade results are about 1 point lower than originally reported, 
while twelfth-grade results are about 1 point higher. These changes are small and not 
substantively meaningful. The eighth-grade numbers are essentially unchanged. The 
revised numbers indicate the same relative distances between reporting subgroups ( i.e ., 
race/ethnicity subgroups, male, female, etc.). The significant national score decline at 
grade 12 is totally unaffected by the revision, as is the absence of significant changes 
at grades 4 and 8. 
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With regard to the state assessment data, all jurisdictions were affected to roughly 
the same degree. Thus, the revised rank ordering of state performance in both 1 992 and 
1994 is essentially identical to that originally published. Original and revised trend 
results (i.e., the change in scores between 1992 and 1994) Eire extremely close for all the 
jurisdictions. However, in four instances (for Massachusetts, New Jersey, Utah, and 
California), the small changes engendered by the revision Eire sufficient to affect the 
statistical significance of the change. For Massachusetts, New Jersey, and Utah, the 
revised decline in scores is between 0.3 and 0.5 points smaller than the originally 
released results — a magnitude of change that was typical across all participants. When 
rounded to an integer, the original and revised declines for Massachusetts and New 
Jersey are of identical size and the decline for Utah went from 4 points to 3 points. 
Despite this similarity, the revised results for these states Eire no longer statistically 
significant since the original results were right on the margin of statistical significance. 
In California, the revised decline in scores is 0.4 points larger than the originally released 
results and is now statistically significant. 

In the results for state assessment achievement levels, there is little difference in 
the revised and original numbers from an interpretive standpoint. As expected, 
correction of the ACT error generally results in lower achievement level cutpoints and, 
hence, slightly higher percentages above the various cutpoints. The revised achievement 
level results in this technical report and in the reading reports reflect the change in the 
formula used in setting the achievement levels. 

There is one notable aspect of the revised state assessment achievement level 
results. Prior to the revision, only one state, Arizona, had shown a statistically 
significant increase from 1992 to 1994 in the percentage of students at the Advanced 
level. Based on the revised results, six more states — Connecticut, Florida, Kentucky, 
Maine, Mississippi, and Maryland — also showed a statistically significant increase at 
that level. 
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APPENDIX B 



Reading Stimuli 

This appendix contains replications of two of the eight reading passages used as the 
stimuli at grade 4. 
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SYBIL SOUNDS 
THE ALARM 

by Drollene P. Brown 



A red sky at night does not usually 
cause wonder. But on the evening of 
April 26, 1777, the residents of 

Ludingtons’ Mills were concerned. The 
crimson glow was in the east, not from 
the west where the sun was setting. 

The Ludington family sat at supper, 
each one glancing now and again toward 
the eastern window. Sybil, at sixteen the 
oldest of eight children, could read the 
question in her mother’s worried eyes. 
Would Henry Ludington have to go 
away again? As commander of the only 
colonial army regiment between 
Danbury, Connecticut, and Peekskill, 
New York, Sybil’s father did not have 
much time to be with his family. 

Thudding hooves in the yard abruptly 
ended their meal. The colonel pushed 
back his chair and strode to the door. 
Although Sybil followed him with her 



eyes, she dutifully began to help her 
sister Rebecca clear the table. 

The girls were washing dishes when 
their father burst back into the room with 
a courier at his side. 

“Here, Seth,” said the colonel, “sit 
you down and have some supper. 
Rebecca, see to our weary friend.” 

Sybil, glancing over her shoulder, saw 
that the stranger was no older than she. 
A familiar flame of indignation burned 
her cheeks. Being a girl kept her from 
being a soldier! 

Across the room, her parents were 
talking together in low tones. Her 
father’s voice rose. 

“Sybil, leave the dishes and come 
here,” he said. 

Obeying quickly, she overheard her 
father as he again spoke to her mother. 
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“Abigail, she is a skilled rider. It is 
Sybil who has trained Star, and the horse 
will obey her like no other.” 

“That red glow in the sky,” Colonel 
Ludington said, turning now to his 
daughter, “is from Danbury. It’s been 
burned by British raiders. There are 
about two thousand Redcoats, and 
they’re heading for Ridgefield. 
Someone must tell our men that the lull 
in the fighting is over; they will have to 
leave their families and crops again.” 
“I’ll go! Star and I can do it!” Sybil 
exclaimed. She faced her mother. “Star 
is sure of foot, and will carry me safely.” 
“There are dangers other than slip- 



pery paths,” her mother said, softly. 
“Outlaws or deserters or Tories or even 
British soldiers may be met. You must 
be wary in a way that Star cannot.” 

A lump rose in Sybil’s throat. “I can 
do it,” she declared. 

Without another word, Abigail 
Ludington turned to fetch a woolen cape 
to protect her daughter from the wind 
and rain. One of the boys was sent to 
saddle Star, and Sybil was soon ready. 
When she had swung up on her sturdy 
horse, the colonel placed a stick in her 
hand. 

As though reciting an oath, she 
repeated her father’s directions: “Go 

south by the river, then along Horse 
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Pond Road to Mohopac Pond. From 
there, turn right to Red Mills, then go 
north to Stormville.” The colonel stood 
back and saluted. She was off! 

At the first few isolated houses, 
windows or doors flew open as she 
approached. She shouted her message 
and rode on. By the time she reached 
the first hamlet, all was dark. There 
were many small houses there at the 
edge of Shaw’s Road, but everyone was 
in bed. Lights had not flared up at the 
sound of Star’s hoofbeats. Sybil had not 
anticipated this. Biting her lower lip, 
she pulled Star to a halt. After 
considering for a moment, she nudged 
the horse forward, and riding up to one 
cottage after another, beat on each door 
with her stick. 

“Look at the sky!” she shouted. 
“Danbury’s burning! All men muster at 
Ludingtons’ !” 

At each village or cluster of houses, 
she repeated the cry. When lights began 
to shine and people were yelling and 
moving about, she would spur her horse 
onward. Before she and Star melted into 
the night, the village bells would be 
pealing out the alarm. 

Paths were slippery with mud and wet 
stones, and the terrain was often hilly 
and wooded. Sybil’s ears strained for 
sounds of other riders who might try to 
steal her horse or stop her mission. 
Twice she pulled Star off the path 
while unknown 



riders passed within a few feet. Both 
times, her fright dried her mouth and 
made her hands tremble. 

By the time they reached Stormville, 
Star had stumbled several times, and 
Sybil’s voice was almost gone. The 
town’s call to arms was sounding as they 
turned homeward. Covered with mud, 
tired beyond belief, Sybil could barely 
stay on Star’s back when they rode into 
their yard. She had ridden more than 
thirty miles that night. 

In a daze, she saw the red sky in the 
east. It was the dawn. Several hundred 
men were milling about. She had roused 
them in time, and Ludington’s regiment 
marched out to join the Connecticut 
militia in routing the British at 
Ridgefield, driving them back to their 
ships on Long Island Sound. 

Afterward, General George 
Washington made a personal visit to 
Ludingtons’ Mills to thank Sybil for her 
courageous deed. Statesman Alexander 
Hamilton wrote her a letter of praise. 

Two centuries later visitors to the area 
of Patterson, New York, can still follow 
Sybil’s route. A statue of Sybil on 
horseback stands at Lake Gleneida in 
Carmel, New York, and people in that 
area know well the heroism of Sybil 
Ludington. In 1978, a commemorative 
postage stamp was issued in her honor, 
bringing national attention to the heroic 
young girl who rode for independence. 



From Cobblestone's September, 1983, issue: 
“Patriotic Tales of the American Revolution.” 
Copyright 1983, Cobblestone Publishing Inc.. 
Peterborough, NH 03548. Reprinted by 
permission of the publisher. 
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HUNGRY SPIDER AND THE TURTLE 

by Harold Courlander and George Herzog 



Spider was a hungry one, he always wanted to eat. Everybody in Ashanti knew 
about his appetite. He was greedy, too, and always wanted more than his share of things. 
So people steered clear of Spider. 

But one day, a stranger came to Spider’s habitation out in the back country. His 
name was Turtle. Turtle was a long way from his home. He had been walking all day 
in the hot sun, and he was tired and hungry. So Spider had to invite Turtle into his house 
and offer him something to eat. He hated to do it, but if he didn’t extend hospitality to 
a tired traveler it would get back around the countryside and people would soon be 
talking about Spider behind his back. 

So he said to Turtle: 

“There is water at the spring for you to wash your feet in. Follow the trail and 
you'll get there. I'll get the dinner ready.” 

Turtle turned and waddled down to the spring with a gourd bowl as fast as he 
could. He dipped some water from the spring and carefully washed his feet in it. Then 
he waddled back up the trail to the house. But the trail was dusty. By the time Turtle 
got back to the house his feet were covered with dirt again. 

Spider had the food all set out. It was steaming, and the smell of it made Turtle’s 
mouth water. He hadn’t eaten since sunrise. Spider looked disapprovingly at Turtle’s 
feet. 

“Your feet are awfully dirty,” he said. “Don’t you think you ought to wash them 
before you start to eat?” 

Turtle looked at his feet. He was ashamed, they were so dirty. So he turned 
around and waddled as fast as he could down to the spring again. He dipped some water 
out of the spring with the gourd bowl and carefully washed himself. Then he scurried 
as fast as he could back to the house. But it takes a turtle a while to get anywhere. 
When he came into the house Spider was already eating. 

“Excellent meal, isn’t it?” Spider said. He looked at Turtle’s feet with disapproval. 
“Hm, aren’t you going to wash yourself?” 

Turtle looked down at his feet. In his hurry to get back he had stirred up a lot 
of dust, and his feet were covered with it again. 

“I washed them,” he said. “I washed them twice. It’s your dusty trail that does 
it.” 

“Oh,” Spider said, “so you are abusing my house now!” He took a big mouthful 
of food and chewed it up, looking very hurt. 

“No,” Turtle said, sniffing the food. “I was just explaining.” 

“Well, run along and wash up so we can get on with the eating,” Spider said. 

Turtle looked. The food was already half gone and Spider was eating as fast as 
he could. 
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Turtle spun around and hurried down to the spring. He dipped up some water in the 
gourd bowl and splashed it over his feet. Then he scrambled back to the house. This 
time he didn’t go on the trail, though, but on the grass and through the bushes. It took 
him a little longer, but he didn’t get dust all over his feet. When he got to the house 
he found Spider licking his lips. 

“Ah, what a fine meal we had!” Spider said. 

Turtle looked in the dish. Everything was gone. Even the smell was gone. Turtle 
was very hungry. But he said nothing. He smiled. 

“Yes, it was very good,” he said. “You are certainly good to travelers in your 
village. If you are ever in my countiy you may be assured of a welcome.” 

“It’s nothing,” Spider said. “Nothing at all.” 

Turtle went away. He didn't tell other people about the affair at Spider’s house. 
He was quiet about his experience there. 

But one day many months later Spider was a long distance from home and he 
found himself in Turtle’s country. He found Turtle at the shore of the lake getting a 
sunbath. 

“Ah, friend Spider, you are far from your village,” Turtle said. “Will you have 
something to eat with me?” 

“Yes, that is the way it is when a person is far from home — generosity merits 
generosity,” Spider said hungrily. 

“Wait here on the shore and I'll go below and prepare the food,” Turtle said. He 
slipped into the water and went down to the bottom of the lake. When he got there he 
set out the food to eat. Then he came to the top of the water and said to Spider, who 
was sitting impatiently on the shore, “All right, everything is ready. Let’s go down and 
eat.” He put his head under water and swam down. 

Spider was famished. He jumped into the water to follow Turtle. But Spider was 
very light. He floated. He splashed and splashed, kicked and kicked, but he stayed right 
there on top of the water. For a long time he tried to get down where Turtle was eating, 
but nothing happened. 

After a while Turtle came up, licking his lips. 

What’s the matter, aren’t you hungry?” he said. “The food is very good. Better 
hurry.” And he went down again. 

Spider made one more desperate try, but he just floated. Then he had an idea. 

He went back to the shore, picked up pebbles and put them in his pockets of his jacket. 
He put so many pebbles in his pockets that he became very heavy. He was so heavy 
he could hardly walk. Then he jumped into the water again, and this time he sank to 
the bottom, where Turtle was eating. The food was half gone. Spider was very hungry. 
He was just reaching for the food when Turtle said politely: 
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“Excuse me, my friend. In my country we never eat with our jackets on. Take 
off your jacket so that we can get down to business.” 

Turtle took a great mouthful of food and started chewing. In a few minutes there 
wouldn’t be anything left. Spider was aching all over with hunger. Turtle took another 
mouthful. So Spider wriggled out of his coat and grabbed at the food. But without the 
pebbles he was so light again that he popped right up to the top of the water. 

People always say that one good meal deserves another. 



Harold Courlander: “Hungry Spider and the Turtle”, 
from The Cow-Tail Switch and Other West African Stories. 
Copyright © 1987 by Henry Holt and Company, Inc. 
Reprinted by permission of the publisher. 
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APPENDIX C 



Setting the Achievement Levels 

Setting achievement levels is a test-centered method for setting standards on the 
NAEP assessment that identifies what students should know and should be able to do. 
The method depends on securing and summarizing a set of judgmental ratings of 
expectations for student educational performance on the items comprising the NAEP 
reading assessment. The NAEP proficiency scale is a numerical index of students’ 
performance in reading ranging from 0 to 500. The three achievement levels — Basic, 
Proficient, and Advanced — are mapped onto the scale for each grade level assessed. 

In developing the threshold values for the levels, a broadly constituted panel of 
judges — including teachers (55 percent), non-teacher educators (15 percent), and the 
general public (non-educators) 1 (30 percent) — rated a grade-specific item pool using 
the Board’s policy definitions for Basic, Proficient, and Advanced. The policy 
definitions were operationalized by the judges in terms of specific reading skills, 
knowledge, and behaviors that were judged to be appropriate expectations for students 
in each grade, and were in accordance with the current reading assessment framework. 
The policy definitions are as follows: 

Basic 

This level denotes partial mastery of the prerequisite knowledge and 
skills that are fundamental for proficient work at each grade. 

Proficient 

This level represents solid academic performance for each grade 
assessed. Students reaching this level have demonstrated competency 
over challenging subject matter including subject-matter knowledge, 
application of such knowledge to real world situations, and analytical 
skills appropriate to the subject matter. 

Advanced 

This higher level signifies superior performance beyond proficient 
grade-level mastery at grades 4, 8, and 12. 

The judges’ operationalized definitions were incorporated into lists of descriptors 
that represented what borderline students should be able to do at each of the policy 
levels. The purpose of having panelists develop their own operational definitions of the 
achievement levels was to ensure that all panelists would have a common understanding 
of borderline performances and a common set of content-based referents to use during 
the item-rating process. 

1 Non-educators represented business, labor, government service, parents, and the general public. 
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For the multiple-choice (MC) and short constructed-response (SCR) items that 
were scored correct/incorrect, the judges (22 at grade 4) each rated half of the items in 
the NAEP pool. These items were rated in terms of the expected probability that a 
student at a borderline achievement level would answer the item correctly, based on the 
judges’ operationalization of the policy definitions and the factors that influence item 
difficulty. To assist the judges in generating consistently-scaled ratings, the rating 
process was repeated twice, with feedback. Information on consistency among different 
judges and on the difficulty of each item 2 was included in the first repetition (round 2), 
while information on consistency within each judge’s set of ratings was included in the 
second repetition (round 3). The third round of ratings permitted the judges to discuss 
their ratings among themselves to resolve problematic ratings. The mean final rating 
of the judges aggregated across MC and SCR items yielded the threshold values for 
these items in the percent correct metric. These cut scores were then mapped onto the 
NAEP scale (which is defined and scored using item response theory, rather than percent 
correct). For extended constructed-response (ECR) items, judges were asked to select 
student papers that exemplified performance at the cutpoint of each achievement level. 
Then for each achievement level, the mean of the scores assigned to the selected papers 
was mapped onto the NAEP scale in a manner similar to that used for the items scored 
correct/incorrect. The final cut score for each achievement level was a weighted average 
of the cut score for the MC and SCR items and the cut score for the ECR items, with 
the weights being proportional to the information supplied by the two classes of items. 
The judges’ ratings, in both metrics, and their associated errors of measurement are 
shown below. 
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TABLE C.1 

Cutpoints for Achievement Levels at Grade 4 



• ■ .. . 

Level 


Mean Percent ' 
(Round 3) 


Mean Paper 
Rating ~ ECR 5 
$gfi$ound3) 


Scale Score* 


Error of 
Scale Score** 


Basic 


38 


2.72 


208 


3.6 


Proficient 


62 


3.14 


238 


1.4 


Advanced 


80 


3.48 


268 


6.1 



* Scale score is derived from a weighted average of the mean percent correct (for MC and SCR items) and the mean paper 
rating for the ECR items after both were mapped onto the NAEP scale. 

** The standard error of the scale score is estimated from the difference in mean scale scores for the two equivalent 
subgroups of judges. 
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Revised Achievement Levels Cut Scores and Student Performance Estimates 

The revised achievement levels cut scores and the revised percentage of students 
at or above each level for both 1992 and 1994 are presented in Chapter 3. These new 
estimates were required when it was discovered that there was an error in the program 
used to develop the levels. In deriving the final levels, panelists’ ratings for the 
multiple-choice and constructed-response items were combined to obtain an overall 
rating for the items. This combination was weighted according to the amount of 
information provided by each type of item, that is, some items “count more” toward the 
overall cut scores than others. The weighting was carried out incorrectly, thus resulting 
in the erroneous estimates in the NAEP 1992 Reading Report Card , the NAEP 1992 state 
reading reports, and the NAEP 1994 Reading: A First Look report. 

The process for developing the levels in 1992 remains unchanged and is accurately 
described in this Appendix, except for the step for deriving the final cut scores using a 
weighted average of the mean percent correct (for MC and SCR items) and the mean 
paper rating for the ECR items. The data in Chapter 3 have been corrected to reflect 
the correct weighting procedure, as has Table C.l, which displays the new cut scores. 

Achievement Level Exemplar Items 

The purpose of providing exemplar exercises is to provide readers with a sample 
of the kind of skills and knowledge that students reaching the achievement levels are 
likely to be able to respond to successfully. They are meant also to represent the kind 
of knowledge and skills embodied in the reading framework. 

The selection of exemplar items for the 1994 reading assessment augment the 1992 
exemplars by providing three additional passages (one for each grade level) and 1 3 
additional exercises associated with the passages. The choice was made on the basis 
of criteria similar to those used in 1992, 3 with one additional selection criterion, namely, 
item format. Since the percent of constructed-response items increased by 
approximately 10% over the 1992 assessment, the choice of 1994 exemplars reflects this 
focus. 

It should be noted that although some exemplars are associated with performance 
data from the 1992 and 1994 assessments (overall and conditional p- values), others have 
only 1992 performance estimates since they were released items in 1992 and not 
readministered in 1994. However, they are all reflective of the assessment framework. 

In Chapter 3, Figure 3.1 provides the final description of the three achievement 
levels for grade 4. Exemplar items, illustrating what students at each level should know 
and be able to do, are included in Chapter 3 as well. The descriptions of the levels apply 
to the framework that underlies the 1992 and 1994 NAEP reading assessments. The 
exemplar items reflective of the levels have been updated to reflect both the 1992 and 
1994 item pools. Table 3.1 in Chapter 3 provides the percentage of students at or above 
each of the three levels and the percentage of students below the Basic level. 
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item pool. A description of this process can be found in Appendix C of Tne‘l99z state reports and in the Technical 
Report of the 1992 NAEP Trial State Assessment Program. - i 
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Reading “Revisit” Study 

American College Testing, the NAEP standard-setting contractor, conducted a 
study to examine the congruence between the reading performance and the descriptions 
of reading performance embodied in the levels, within the context of the reading 
assessment framework. The purpose of the study was not to set new levels, nor was it 
to develop new achievement level descriptions. Rather, the “revisit” was designed to 
evaluate the descriptions of the 1992 achievement levels with respect to their 
appropriateness vis-a-vis student performance on the NAEP. Two methodologies were 
used: (1) evaluation of the achievement level descriptions via statistical item mappings; 
and (2) evaluation of the descriptions via judgmental item mappings. 

In the first procedure the NAEP exercises were classified according to the 
probability of a correct response at selected points on the NAEP scale. One half of the 
panelists then examined the items falling into each category to judge whether the 
exercise content corresponded to the descriptions of those levels. In the second 
procedure, the other half of the panelists were asked to classify each exercise as Basic , 
Proficient , or Advanced according to whether the item matched the description for the 
level. Once all the items were classified by all panelists, they were asked to evaluate 
the extent to which the descriptors represented the skills and knowledge covered by the 
assessment. 

After both an independent and a joint evaluation of the descriptors by panelists in 
both groups to determine whether the 1992 descriptors were appropriate for reporting 
performance on the 1994 NAEP reading assessment, the panelists were asked to 
recommend specific changes in the descriptors. Based on the findings of this study, it 
was the consensus of the participants that the descriptors used in 1992 were, in general, 
appropriate and consistent with the NAEP Reading Framework and the 1994 NAEP 
reading assessment results. However, the panelists recommended minor modifications 
in the descriptors. Their recommendations are reflected in the 1994 Student Performance 
Level descriptors. 
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APPENDIX D 



Data Appendix 

For each of the tables in Part Three that presents reading proficiency results, this 
appendix contains corresponding data for each level of the four reporting subpopulations 
— race/ethnicity, type of location, parents’ education level, and gender. 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D5.3 

Public School Teachers’ Reports on the Availability 
of Resources 



1994 Trial State Assessment 


1 get all the resources i 
need 


1 get most of the resources 
1 need 


I get some or none of the 
resources 1 need 


1994 




9/ / • Percentage and Proficiency 



TOTAL. 

State 

Nation 

RACE/ ETHNICITY 



White 

State 

Nation 

Hispanic 

State 

Nation 

American Indian 
State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urb Frng/Lrg Town 
State 

Nation 

Rural/Small Town 
State 

Nation 



£2 28^3&)!| 
9 <*7) 1 
..235(3:7 



230{3.3)l« 

10 ( 2 . 0 ) 

-233^7)^ 

B < 2 . 0 ) 

- <•*■•} ; 

pi 

I < 2.8) 

■ 

6 {2.4) 

ir*cvr 



13 ( 4 . 8 ) 

. CV) : 
10 ( 2.9) 



V o (- 0 . 0 ); 

l' : i *#*/***-> 
10 ( 2 . 1 ) 

12 ( 3 . 5 ) 

^l22S9l(,4.6)! 

MmINB 

223 ( 5 . 0)1 S 



ippii:i 

191 



59 ( 3.7) 

221 £ 

55 ( 2 . 7 ) 

: 4 ( 

58 ( 3 . 2 } s 
^ 223 (\ 1 ; 8 ): : . V 

•:i 

65 ( 5 . 4 ) : 

206 ( 3 . 5 ) 

. 50 ( 3.6) 

; '192 (" 2 . 6 ) ;V 'i 
: v ;.p 

eo •( 53) > 

203 ( 3 . 6)1 

208 ( 5.1) , 

HlilSilSiBJ 

56 ( 7 . 5 ) 

219 { 23 ) 
46 ( 3 . 9 ) 

207 ( 3 . 7 ) 

59 ( 9.9) 

■m IflH 

221 ( 2il) ; 

li'V 

60 ( 4 . 9 ) 

1 65 ( 4 . 9 ) | 

212 ( 2 . 5 ) 



|I^;(||B)||||P» 



: ■ 227 ( 2 . 6 ) :: 1*111 

220 t 2.0) 

' ; 27 ( 5 . 2 ) Silllli! 

Sllilll 

33(4.9) 

200 ( 4 i) . 

■ 36(4.1). 1111:11 

3K 

198 ( 2.8) 

■m rnmwwM ■: i i : .1: ^ ; : -i-': 



USB! 



illllli 



r M .** . 

. - 41 ( 9 . 9 ) 

P|;i3^l5^piS 

216 { 2 . 9 ) 

lii ; 

225 ( 32 ) 

§Sg2T4:!(f4i2) 






(continued on next page) 



o 

ERIC 



126 



1 

/w 



°o 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



Montana 



THE NATION’S 
REPORT 



CARD 



isaep 




TABLE D5.3 (continued) 

Public School Teachers’ Reports on the Availability 
of Resources 



1994 Trial State Assessment 


1 get all the resources 1 


1 get most of the resources 


1 get some or none of the 




need 


1 need 


resources 1 need 




1994 






Percentage and Proficiency 


; ' ;; |'7 ; - 'ic .. I? - 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.1 

Public School Teachers’ Reports on Instructional 
Materials for Reading 



1994 Trial State Assessment 


Primarily Basal 


Primarily Trade 
Books 


Both Basal and 
Trade Books 


Other 


1994 


TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 
State 

Nation 

Hispanic 

State 

Nation 

American Indian 
State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urb Fmg/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 
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TABLE D6.1 (continued) 

Public School Teachers 9 Reports on Instructional 
Materials for Reading 



1994 Trial State Assessment 




Primarily Trade 
Books 



Both Basal and 
Trade Books 



Other 



1994 



Percentage and Proficiency 



PARENTS’ 



EDUCATION 



College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 
State 

Nation 

I don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 



Female 

State 



Nation 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.2A 

Public School Teachers’ Reports on the Frequency of 
Using Children’s Newspapers and/or Magazines 



1994 Trial State Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1994 


TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 
State 

Nation 

Hispanic 

State 

Nation 

American Indian 
State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urb Fmg/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 
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TABLE D6.2A (continued) 

Public School Teachers ’ Reports on the Frequency of 
Using Children ’s Newspapers and/or Magazines 



1994 Trial State Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1994 


PARENTS’ 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 
State 

Nation 

1 don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.2B 

Public School Teachers ’ Reports on the Frequency of 
Using Reading Kits 



1994 Trial State Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 




1994 






TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 
State 

Nation 

Hispanic 

State 

Nation 

American Indian 
State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 
State 

Nation 
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TABLE D6.2B (continued) 

Public School Teachers’ Reports on the Frequency of 
Using Reading Kits 



1994 Trial State Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1994 


PARENTS' 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 

State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 

State 

Nation 

1 don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.2C 

Public School Teachers’ Reports on the Frequency of 
Using Computer Software for Reading Instruction 



1994 Trial State Assessment 



At Least Once a Week 



Once or Twice a Month 



Never or Hardly Ever 



1994 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 



White 

State 

Nation 

Hispanic 

State 

Nation 

American Indian 

State 

Nation 

TYPE OF 
LOCATION 
Central City 

State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 
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215(5.1) 



Percentage and Proficiency 
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34 ( 5.6) 
218(4.0) 

|£fgj£44} 

36 ( 6.5) 
23 ( 3.8) 

20(3.1) 
221 ( 3.8) 

217(5.4)! 




(continued on next page) 




134 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



Montana 



THE NATION’S 
REPORT 



CARD 



rcaep 



M 



TABLE D6.2C (continued) 

Public School Teachers’ Reports on the Frequency of 
Using Computer Software for Reading Instruction 



1994 Trial State Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1994 


PARENTS' 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 
State 

Nation 

1 don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 
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: '22(12.1) 

220 ( 2.8) 
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Percentage and Prof icie ncy 
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' ■ 24( 2.6) - 

p iffsy m 
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f V 4 ’.PC 
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11 : 1 222 ( 3 I 0 ) llillll 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.2D 

Public School Teachers ’ Reports on the Frequency of 
Using a Variety of Books 



1994 Trial State Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1994 


TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 
State 

Nation 

Hispanic 

State 

Nation 

American Indian 

State 

Nation 

TYPE OF 
LOCATION 
Central City 

State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 
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TABLE D6.2D (continued) 

Public School Teachers’ Reports on the Frequency of 
Using a Variety of Books 



1994 Trial State Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1994 


PARENTS’ 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 

State 

Nation 

1 don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.2E 

Public School Teachers’ Reports on the Frequency of 
Using Materials from Other Subject Areas 



1994 Trial Slate Assessment 



At Least Once a Week 



Once or Twice a Month 



Never or Hardly Ever 



1994 



TOTAL 



State 

Nation 

RACE/ ETHNICITY 



White 

State 

Nation 

Hispanic 

State 

Nation 

American Indian 
State 

Nation 

TYPE OF 



LOCATION 



Centra) City 
State 

Nation 

Urto Fmg/Lrg Town 

State 

Nation 

Rural/Small Town 
State 

Nation 
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TABLE D6.2E (continued) 

Public School Teachers’ Reports on the Frequency of 
Using Materials from Other Subject Areas 



1994 Trial Stale Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 




1994 






PARENTS' 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 
State 

Nation 

1 don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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1994 Trial State Assessment 



TABLE D6.3A 

Public School Teachers ’ Reports on Asking Students 
to Work in a Reading Workbook or on a Worksheet 



Almost Every Day 



At Least Once a Week 



Less than Weekly 



1994 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 



White 

State 

Nation 

Hispanic 

State 

Nation 

American Indian 
State 

Nation 

TYPE OF 



LOCATION 



Central City 
State 

Nation 

Urfo Fmg/Lrg Town 
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Nation 

Rural/Small Town 
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Nation 
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TABLE D6.3A (continued) 

Public School Teachers’ Reports on Asking Students 
to Work in a Reading Workbook or on a Worksheet 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 






Percentage and Proficiency 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.3B 

Public School Students’ Reports on Working in a 
Reading Workbook or on a Worksheet 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 


TOTAL 

State 

Nation 

RACE/ ETHNIC TTY 
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State 

Nation 

Hispanic 
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American Indian 
State 

Nation 

TYPE OF 
LOCATION 
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Nation 

Rural/Small Town 
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? mm^^m 

. v ■; B .Er|:i'26;(|lMfc^^ 

— !*- :: ri 

29 ( 32) 

: 25(3.7) 

lSliiiB|h«fpill 

•V : -.<. $ 0 : y- yy f ; B. !■:..: :: . • -. : .•: :i ' • 

. . 

22(2.5) SBill 

' jt 

: 25(1.5) 

• 

. 34 ; ’ 

■; 24(1.3) : 

209(2.7) || 

■ :• ■ *■■. ■' ■■ j. ■' 

25(1.4) 

( 2.4) 
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TABLE D6.3B (continued) 

Public School Students’ Reports on Working in a 
Reading Workbook or on a Worksheet 



1994 Tnal State Assessment 




Almost Every Day 




At Least Once a Week 


Less than Weekly 










1994 












Percentage and Proficiency 




PARENTS’ 




||||| ||| ill 




* > u -.a ' ' 4 v * s \ 


4 444444 : '.444' ■■;4;4^4:::- ;4:^;4:::;;:;.-4:;:;44;--:: 4::;;4:^ i-i 


EDUCATION 




; 44444; 44 - • 




V • t'f. . v4/ ' \ : ’ V ! 'x ■> 4 • ':'V<4 


4 : - ; 4- 


College graduate 








1 >fc S * 




State 








' i : v 


SIB •• 22 (1.6) 




1'%'S 


llilH232|(|2,0) 


||| 




s ! 3J^i|22ic%5) s ss 


Nation 








mmm 




Some ed after HS 








k / ;;; f * 1 ; < 




State 




54 ( 3.3) 




: 25(2.8) 


! ii;SilS}| 21 { 2 4 ) | S|||; 4 












: 4 '4 'l : '4-4 4;;444 


Nation 




|p!fe 48 ( 3.1) 












wmm* 




liilll 223 l 3 -2) l-v- 


• ■ 216 ( 4.0) . ' 


HS graduate 








State 




: p • 




20(2.1) 111;! l-l 


11 ilillll . 26(2 £) 111 !!|! 












Nation 














!Ji|P|ig2.6) 




, 209 ( 3.4). 


{; , ? ^}'1 193lf S-WBfe ' &&A 


HS non-graduate 


' 


- 4 " 3' 




;-;4:i4:.:4 :'444 2 ; : ' : : : : 2 ; >:; 4 ! ; ;; : ; : ;4: : :4i: 4;:::-;;:: 


, 


State 






'VT- 


441443m 


36 ( 5.3)' 










1 f vim ; if 


iv^lf |> > S:X: 


Nation 


* 4 - 




>4 


jfe? &* 












175 ( 7.3) 


1 don’t know 


' 




' 


iMif ; 4444 4 4 ; 4H : 4 ; Cl; 


State 




V;.,. . 






' :4 44 ■ ' 24( 1.7) 44 | 




•ill! 


216 { 2.5) 


4 4 


221(2.6) 




Nation 




>::C- :.47.C13) . '-v 




27(1.0) 


t2) 








■ : 


p§SH£ ||| 


5 196(2.4) * 

.-44 4'-4 :: if' 

-4 4 : 44 ^ 4454444 o44^44 f'| j 


GENDER 


UK 




®§ 


4 ; <*}. l; 4 '4 :;4 : 4 : 4 : 44:, -3 £ ". ; : £ ■ 1 - - :Ci| i 


Male 


'■■■ ■■■ 4.4 








State 




Hip 5lpl9):':D3-- 




ll SCi; 25 { 1,6) 


4 - : • 44 . 25 [ 1 .5) ' 4. ' ' 




§111! 


§ 222 (1.6) 








Nation 




. ;< j 






( 1 :4)' 4 1|§| 


Female 


min 


44 \4 




|||4| |||||2o| WW\ WM |i|| 


198(2.5) 


State 




|1| 52 ( 2.1) 44||4 ; 




24 | 1.5) H! (Il 


23(1.5) 






228(2:1) 




1 230(2.6)^frc:^% 


222 ( 2.8) 


Nation 


1 


Kl :l k' 




SfS&#26^T,rt)' rgi v \ . fe 








111 







The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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1994 Trial State Assessment 



TABLE D6.3C 

Public School Teachers ’ Reports on Asking Students 
to Write About Something They Have Read 



Almost Every Day 



At Least Once a Week 



Less than Weekly 



1994 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 



White 

State 

Nation 

Hispanic 

State 

Nation 

American Indian 

State 

Nation 

TYPE OF 
LOCATION 



Central City 

State 

Nation 

Urb Fmg/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 



|S 2 spSS 2 jiii 
M2 <^ 5 ) 1 



3J4)P 

^> 5227 ^ 2 . 5 ): : ; 

i4S^3Qtl2i9)b 

^ 26 (45) 

' 36 ‘il^i 

immxt (3^)i 1 

29(4.8) 

wmm&m 



40 ( 9.3) 
219(4.0)1 
■ '27 04 2 ); : 

201 ( 5.8) 

39 ( 12 ) 
223(7,5)1 
ir. 33 ^ 3 . 9 ^ 
220 ( 2 . 8 ) 

23 ( 3.5) 
Hl222 (£ 3 ) ^ 
28 ( 4.8) 



Percentage and Proficiency 



IIS6ipl3)| 



8*53 f 3.7} 
, 226 ^ 1 . 4 ) 
#§ 56 ^ 2 . 6 ) 
224 ( 1.6) 

V 6 d|S!®[ 

S£l^ 4 . 0 ) 

■^ 90 ;p 2 ; 4 )r 

47 ( 5.8) 
201 ( 4.0$ 
60 ( 4.9) 
199 < 5.7) 



58 < 8.9) 

218 ( 4.5) 

206 ( 3.0) 

55(62) 

: 225 ^' 3 ^)fg|: 

220 ( 22 ) 

67(4.2) :'/• 
224 ( 1.8) 

' - :55( 4.5) tM 
213 ( 2.4) ' 



'*1223 ( 3:3)^^?€« 

14(2.0) 



14 (2.7) ;4 »§§ 

iBssimnHnBs 

224 { 2.3) 

mmmm&mS MSM i 

fB^ asitsafe 5 ' ? r ; 

vVli • 7 

>?;: v; : T7:(52): : : ; : : 

2.7). .; 

7 So 

Klllllfxl 



5 ws: 

- vM3\ i o V 

??»:?2Q4 { 5.3) ' ' i; . 

, „ 81 

6(3.7) - 

14(3.1) ■ ' ' 

:ifl223 : (.3.1)!,. :■ : 

V? 20fC.-„ 

223 ( 3S): 

18(5.0) 

k^r2l5:(.5#cC ; «l^.® 

I'i : , J ;... -J; : _• • J-‘- - ' 



’ ■ 
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TABLE D6.3C (continued) 

Public School Teachers’ Reports on Asking Students 
to Write About Something They Have Read 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 


PARENTS ’ 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 
State 

Nation 

1 don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 


/ j W.a J'i] ^ pi 

' 28 ( 3.5) ■ 

■ : . " 

27 { 3.3). . ■ 

217(4.2) 

29 ( 4.4) 

204 ( 4.0) ■■*&?;& 

. m:*.W • 

■■ . ■ (** ’) ji- : . K. : 

SiSili I li|l IS Ip88®i 

Ip : 30.; 3.7, : 

214(3.1) 

30(2.6) 

. 204 : (l2,7)SSp;|3i 

l 

B|llll|l 29 £ 3.3) Splill 

.■ 207 * 2_7 i 

I:1K " 29(3.5) MM 

piiiiifi . i' i nj t M-M 

Wmm 29 ( 2.3) 

HlBHi R 


Percentage and Proficiency 

W< 57 { 3.7) . ‘ V.' : 

l|l| 111 '64. (4.7) . . 

r^tvi |^i>56 1 3:6)'';: > v '^' : 

~ 57(5.1) 

i \ 35)1 

S3HK3SB 207(2.9) 

52(7.5) 

l !:54X>4;7) v: 

MSSM: 188 ( 4.9) pifflfiglg 

W$Mmli&M§AM ISItil 

7 *£ * V4i • ' 

?54^a^) - ■ir#:? kli 
u |§|j 205 c 1.9) |j;| g||gg 

i M W( ; 30:WM§m 

218(2.0) ,, 

; 55 ( 2:4) Mini 

58 :( 

7 (&3)^r Mv 


F a*" ®f#S 

14(2.4) !;jf 

itelS8ig23o:xeKO)||i«ji:iig;S 

satis 

: w-J.?;® 1 

Is ?JI ;M^|34) ■' I 

djj : ;l. 46 ( 3.0) : : ; 7 1 

^slsm 

18 ( 5,0) 

-r.-) 

| : ‘ ' p V. 

15(2.8) 

gs 

208 ( 3.4) 

15 ( 2 . 6 ) ' 

•i . 220 (:^;p 

226 ( 46) 

■nail 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.3D 

Public School Students’ Reports on Writing About 
Something They Have Read 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 


TOTAL 

State 

Nation 

RACE/ ETHNtCTTY 
White 
State 

Nation 

Hispanic 

State 

Nation 

American Indian 

State 

Nation 

TYPE OF 
LOCATION 
Central City 

State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 


220( 2.5)a { 

208|(Wl8)lSilSilll 
& 3. T : Sr , ; :v.. ■ 

; 1 ■■■ h- 

IBINv -17(1.3) ' 

PS^Uifi 

220(2.1) 

(•••? 

1| 182 < 32) 

21 ( 2.3) 

■HppM H lgg 
»»»i 

i|Jp 1 v 

■J - '2* -'A&im k.;VV.iai 
T'fc&^pnrofci) *-ut s/. .->s 
1 i l ;| I 

197(2.9) 

20(2.8) 

1 223 ( 5-2)1 

iifiai8is<p4)' ■ 

218(2.8) 

: ■ : 15 ( 1.3) r; ■ 

220 { 3.3) 

, 21(2.0) ; 

209 (3.7)H;1; 

IS 


Percentage and Proficiency 

, -**> - ' 

: 4 s .- 

215(1.4) : : 

. 32 ( 1 ..2) ■ * 

;V' 

m g§§ 1 ii22g(®^ji (i niii 
NIRNI 33 ( 3.2} /; : V; 

sup & f; £ 

BKllSi 29 { 4.2) 

202 ( 6.5)1 . 

? SB §? '"i'<3f(33)' 

•~rv) 

: . 'V; • 31 ( 1.9 ) : .:v ■ 

1 & ; ' * 220 (42) 1 ; % 

•V; SRilD- i M 

208 { 2.5) ■ ' : 

: 31 { 1.8) V 1 

' 222(5.5)' 

IPs j§m^< i^); iigp 

■ 221 (2.4) ■ ' 

■mm 33< i.h) 

30(1.6). 

213*35) 


“ • wv. > . ... . ■ ;. w . .-, - •■ -• •■■;■■ ■ :■■ )>««■ ■■■■ ; r-r p :*■ 

50(1.7) 

S St ; ,«!iS ; :< -iis); 

, 2i6;<:V;3) ■ 

. ; r 

50(1.8) ' 

mmmmmm ■ ■■; • - 

i“'-^.»Y^'X47.,{-a(2), . 

: ; r ■' 224 ( 1.5) iMliB 

t ty: ; 51 ( 4.1) ' lllll 
S£S*209 : ;t^8); s \\. : 

■MS'A. 190(3.3) IIIIJI! 

Htt 50(5.2) ' Bill 
. 206{,3.3):^,&^: 

illllmi 44 { 3.9) ' ' 

47 < 3.2) - . ' 

-r ;218:{342)' ' ' • 

- ;,s;:h* ■*% < w <■%- 

209 ( 2.8) JjJgfj 

ss ; : 49 ( 3.5) - 

226 ( 4.0) 

• ; ■- . 

221 (IS) V 

. V, •" 52 ( 2.1) 1 ,-V •• 

224(1.9) , 

■ %Pj%> i 

,^.V 7- 7 217.(2.4) 
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TABLE D6.3D (continued) 

Public School Students * Reports on Writing About 
Something They Have Read 



1994 Trial State Assessment 



Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 



PARENTS’ 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 
State 

Nation 

I don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 



18 {si j 

3; 

' 724 fl. 

217(2.: 



iilllli 




215 ( 4.1 



-XT. (2X» 

7 .7. 

- . ’':ZA, (2.1) . 

X+ 

25 ( 5.6) 

- <**•*) 

► V28{3i5): s : 

186 ( 5A ) ; i 

6 22 ( 12 ) 
198(1.8) 



16(1,2) 

22 ( 12 ) 
203 ( 2.6) 

227 ( 3.0) 
212 ( 2 . 1 ) 












Percentage and Proficiency 



iz'&i ^tS);Vr ' C 

O 1 

225( 1.8) 

36 < 3.6) 

■ f ... 

7 !;:33 <.£4). 

223 ( 3.3) 

31 ( 3.3) 

r'V ' ; -s2»<'4.«i) : 

205(2^) 

*(JW) 

; 34(3.7) 

B ( 2 . 0 ) 

( 11 ) 

' 






liiliiit 

220(2.5) 

lliiilipll 

33(1.4) 

-T r V'l? y 228 t {^^' 1 

34(1,2) 

IS 1221 < 1 . 6 ) 






: 



sKSlItii 

sS®fll! 1 



®^25K*3i 

>3Sr.^{2# 

52 ( 4.3 

213 | 245 



il 

m- 



■mmm- 

208(22) 

52 ( 2.0) 

220 (1.7) 

210(4.6) 

V ; 48(2.0) , 

. : 41 ( 1.3) V 
; ; 223 ( 1,4) 



:: 



111 ! 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.4A 

Public School Teachers ’ Reports on Discussing New 
or Difficult Vocabulary 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 




1994 






Percentage and Proficiency 


y yf j; yj y 


TOTAL 


•, - p ' ' , v"" j ^ v v 'j y : 


yr 7 ' C Jly yV y 1 


* ’ 


State 


59 ( 3.1) ■ 


m 41 ( 3 . 1 ) 


0(0.0) 




221 ( 1.7) 


• 225(1.7) : ■ ' 


> iv S * < -*** y<*» *\ >' 


Nation 


62(2.5) 


37(2.6) 


1 (0.5) 




211(1.4) : 


218 ( 1.5) : 


"*rn 


RACE/ ETHNICITY 






11! 


White 






L- ^•■•1 'V*!" ' > i:^'v 0 - s .7 *' 


State 


5S ( 3-2) 


i'V/r '42 ( 342) ' « 


0(0.0) 




225 ( 1.7) 


228 ( 1.6) 


♦*»■/*♦ • 
( • ) 


Nation 


Jrr61{2.8)^;h;: '< 


38(3.0) 


1 ( 0.6) 




9'W: } "221 ( 1*8}f , j >; 


226 ( 17 );- y 


? > ??¥ S.S 


Hispanic 


" , f \ 




' « 'T' v u Ti? ' .f . " " ^ . r# ; v - 


State 


. : 59(4.9) 


ii?S54i ( 4 . 9 ) y 


0(0.0) 




209 ( 3.4) 


206 ( 5.0) 




Nation 


* ;r; 71 (3.3) - < l 


29(3.2) 


1 ( 0.4); 


American Indian 


189(2.6) 


194 ( 3.6) 


1 ' Vs- v v / 


State 


jiHfilB l 73 (:fc2>\ y p ■' 


27 ( 6x2) 


0 ( 0.0) 

-• (-.*) 

'■■ ■■ V 1 : 3 ( 2S) y*-. ; 




199(3.1)! 


,-V<Y , "" "V , 5 ^ 


Nation 


59(5.1) 


38(5.0) 








H . xVVis 


TYPE OF 
LOCATION 


l:: 




t: y,”j y .y-i” -7..,-, r. 


Central City 


ip K | lit vy * : 111 




7 ^ : - . 


State 


; 71(5.8) 


29(5.8) 


( ri 




219 ( 3.2) 




Nation 

Urb Frng/Lrg Town 


; j : ^ J^202 


34 ( 3.7) 

.;f.yypyy;;2t0:(3.6} 




State 


58(9.8) 


' y'^' f 42{Vi) ' V • 


y 




221 ( 4.0)! 




Nation 


62 ( 3.0) : 


l;y y^-36<3J2) J 


2(1^) 




I'tf'X (22) 


V* jz '\2»i2JQ' '< *1 


f-, ^ V '***^(*^^*1 ' ' 


Rural/Small Town 


~ < A . -- : . *' . • \ . 




l;" i," 

' . 0(0-0) 


State 


■' C'V: 


%y : 44<4.0) : . .1' S 




; #^Ol;ll221 ( 22) H i 


^iiifi^li|226 ( 2;1)' ?* 


§smm iiiiiiiii 

77ta§U VvV.;; 


Nation 


58(6.6) 


f < St 42(6.6) ; *; ' *?: \ t ; 




211( 2.7) 


#:2*7{22l t < - >< 
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TABLE D6.4A (continued) 

Public School Teachers’ Reports on Discussing New 
or Difficult Vocabulary 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 


PARENTS ’ 
EDUCATION 
College graduate 

State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 

State 

Nation 

1 don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 


' 

' • 57(3.4) • 

I 8 *i§si 220 (? 210 ) 

.1 

jgniifeo ( 2.81 
!IS*I. 66(4.2) 

: • 2O5 02&0 

v- c iw 

■ '* : 

ms 

: 65 ( 2.5; ■ . ; : 

204 ( 1.9) 

; $ 

62(2.6) 

■ • 206 < 16 > 

’ ' 22| l || : 

M f^w®4®2|6) 1 :%1 m 


Percentage and Proficiency 

3A):<yy :v ' f i 
iCI-' ■ jS'lSiSK((225X' 

3.0) V- v I - & « v ; 
$' f ' 'i228'( 2Apf 7 v ;£ 1 

II/ ' 4i (4.2)"- 7 - 

i^pgS!2307(:p)) r \> 

=• 

: Ji; 3>)j4> v ; ^ * ; g 

34 ( 4.2) 

%| d'i;^223:f?3.5)^^i aV;M 
fill • ■ ^ii||l35 <3^2) | if lil i| 

"212 ( 3.4) 

Ullii f ■ , 39(.7,1)- v - l§iSl|| 

i87(5.s) ' 

m pp 

42 ( 3.2) 

iis® 221 ( i.9) 

ilglliigiip 2 . 0 ) iifliifili 

39 ( 3.3) 

^®SfJU37i< if 


■m ■ 

- . { ' : . 

•°(°? 3 : § 

- : 0 ( 0.4) / 

111*® 0(00) *1111 

0(0.0) 

? ill 1* ** 

1 ( 0.8) i , 

...(...) 

jji jj iS^lioBillBlMB 

: : ;*jl ( 0.7) 

iii 

' T** ;ii ’i • 

0 ( 0.0) 

1** •) 

1 ( 0.4) - 

BBUHi 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.4B 

Public School Students’ Reports on Discussing New 
or Difficult Vocabulary 



1994 Trial Stale Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 




1994 






TOTAL 

State 

Nation 

RACE/ ETHNICfTY 
White 
State 

Nation 

Hispanic 

State 

Nation 

American Indian 
State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urb Frng/Lrg Town 
State 

Nation 

Rural/Small Town 
State 

Nation 


4 ■ -1226 :( V &) • t 

■ J 32 { 0.8) 

33(1.4) 

225 ( IT) 

= - 23 < 2.9) .. 

{ 1J9 
192 ( 3.8) 

34 1 4.6) 

: 205 { 4.8)1 

■. : : .33(5.0) , - ■' 't 

• . •"•n 

“ 

. . . 

34 ( 1J2) 

^ M I 

33 < 1 %; > ISj 

206 ( 3.2) 

■' ■ ■ 1 S -'A A ' ' ’'f~ A : ' K 

27(3.0) 

227 ( 4,2) 

|11|| 1 33 < MM ■ !v:; 

32 { 1.7) 

226(2.6) 

-31 ■(i.S),.- 

Wi i 1 ■ M8 ml MHi 1 SI i 


Percentage and Proficiency 

feQj g 37 ( 1 ..2) 

228pf8) ^ c 

S| l|S!8S36 (^o: 8) , « s ^ I 
^ >; ^ ^218 p ^ 

Wmm^( 0.9) . • . 

s/:- 39(2.7) 

206 (|417) 

192 ( 4J2) 

30 ( 3.8) 

209 ( 5.7) 

' 29(3.9) :.7.: 

..-rv) 

■y a# ;•.* : wM\ ■ $ vyt i & 

y| 7 y j : : yi W0§ }l fly ; y i; y | ■ 

i 33 < ' 

J& 

. ’ 210^2^)>|> 
MmV K&0ES0i lllBl® 

37 ( 1.1) 

224 ( 2.1) 

' ^ 38 ( i .6) fffiilS 

Ei 

219(2-5) 


31 (1.1) 

** 2O7-i0A)<!?€~ fef® §» 

m:Wm mmMMM 

WM ' 30 ( 1.2) FPM 

:#S®Blifi218’('1.9) , : Jl 

216 ( 1.9) 

38 ( 2.8) V ■ 

206 ( 4.9) > - 

■ =. -■ : ! : ■ ; <4% 

35 ( 3.5) 

: ' 197(3 J2) .: fc ' m ffi 

^ siV i? f , 

i; 5 pyrg)«^rtf^s 

: : -33(i.8) - : 

33(1.1) 

. : ! 4. : ! . ' : :: 

217 (52!) 

30 ( \2) 

213(26) , 

30(1.4) 

M.;fc 1$ 32(1.6) ' ). -:. 

207 ( 2.7) 
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TABLE D6.4B (continued) 

Public School Students’ Reports on Discussing New 
or Difficult Vocabulary 



1994 Trial State Assessment 



Almost Every Day 



At Least Once a Week 



Less than Weekly 



1994 



PARENTS’ 
EDUCATION 
College graduate 

State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 

State 

Nation 

I don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 




32(1.9) ‘ 

KMS 

WNSMM 

. : ■■■■■■ ' 



i|| ^ | ■; ||1|||1 m |||||1| 

i ^ \ 

i : 35(24) ' - 

mmzfrvA: -"■■■■ ■ ■■ ■■ ■■ ■ ■■■ ■ ■ 



30(5.7) 

:*»* r**.*) 

it ; n 

&5S;i92 i (-;6.i)'' , . :?* 

32 ( 1.9) 

217 ( 2.9) 

®1||1 31(1.3) , 

206(1.9) 

it: 'll" ■ ~ iv*’: 

' - - - . ■ ■ ■ 



Percentage and Proficiency 



40X1.5) 

235^2£p 

38K'^:o) 

\*J'< In I 

43 ( 2.8) 

li|p|| §231®^9)l 

40 { 2 .6) : 
225 < 3.3) 

37 ( 3.0) 

29 ( 5.1) 

/ ' 196( 4.7) 




220(.2.b) , 
29(1.0) 

208 ( 2.3) . : , • 

v ; . . . : : : ■ ■ • ■ ■ ; ■ ■ - - ■■ ■ : , : . ■ . ■ ; 

| l|l 35: ( 1,8) . ; . : 

v; 36 ( 1 . 0 ) 

, 220 ( 1 . 5 ) r;; : J 



&&&% fcfip 

220 ( 2 . 6 ) 

211 < 22 } 



223(2.3) 

WmOBSSSm^)-- 

g|fff ^ 213( 2.0) 

§ 0:18 38 ( 1.6) I 

232(1.9) 

WSSSe^^W 

223 ( 1.4) 



l||i||l;!|! If If J |||f || III Mggggm 



1<122if(3»i) - 5 ' 

l®SlB^iP;0) 

\f € * *iV»(aS5) \! 

%;216X 512) 

|||J!^4|gj2;(;3^ 1 ; 

30(2.8) 

Ip^^i33^l0) : ::- 

205 ( 2.8) 

41 ( 6,3) 

*** {+* 

180 { 5i9)||S 

35(2l0) 
209 <239)$ ; /J 

199(1.8) 



I pili; 

p $ 8$ 35{i.o) f 
• 204( 1,7) 

• 27(1,4) 

216(2.7) 

;27 ( 1.0) 






The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.4C 

Public School Teachers y Reports on Asking Students 
to Talk With Each Other About What They Have Read 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 


TOTAL 

State 

Nation 

RACE/ ETHNICTTY 
White 
State 

Nation 

Hispanic 

State 

Nation 

American Indian 

State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/S mall Town 

State 

Nation 


lilSi:;. 39(3.7) 

; . ■ . : V • 

227 ( 2.0) 

ftfr - f 

■ttt- ■*«•< sj&a 

188 ( 4 4) 

• i 1 ,1 i > < S'8*'S;*A<' Xi'', 'sr 

,' fv % ' +' ** y/* * 

■ £\i% Vi;x 

;;|$S | gi ;|g I v 

: :: ; : 

45 ( 7.6) 

| :/! : ?g<i$i|§|§|:© 

ill iill 

:: 44 : 8.8) 

lipiii 

37(4.6) 

-f, ;T , -« 222 *J» 

I|l|Stlll 25 ( 5.5) fe ttl 
209 ( 3.3)1 

cisesi i&s ? L £1 ' 1 


Percentage and Proficiency 

!S^^lS2l5^§iiS 

t ' ' ; \ } !\ 215 < 

illiffil 45(3.2) IIS 
£liMil|226 <ii 

| i||: .223(1.7) r; > 

l|| il 43 ( 5.3) II 

S?1 

i£492X2A))i % ft gy < 

31(6.0) 

’ 209(4.0)1. ; 

felffl mm W&tyt li*B8 

220 { 4.1) 

207(3.2) 

: ml; 41 ( 6.9) : p 

; " 

lllliiia7 (;3.5) - ' 

220 ( 2.2) 

44 ( 3.9) 

215(2.3) 


81 i! lllilllffiiil ■11111 1* 

222 ( 2-7) / 

18;(“1’.8), : : 

||||13fl|2i^(:2;?y ItSlBlii 

1 17 ( 26) 11: : : 

S€ *-.V* •: & : ; * 

i - r *) • 

,;, 1; 

jglifll^p9Ti5l9glttaSi 

pn mi : : i ; 

7: : ::,s : 14(23) 

ip 

•' ; 

17(3.1) : 1; . 

204 ( 4.6) 

16(6.9) 

*” (*?•*) 

16 ( 2.9) 

1 ,. • 

19(3-4)1 

214(5.3)1 
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TABLE D6.4C (continued) 

Public School Teachers ’ Reports on Asking Students 
to Talk With Each Other About What They Have Read 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 




1994 






Percentage and Proficiency 




PARENTS’ 






5 : (3 


EDUCATION 


III 'j \ , v : ' 


- C;,v ’ \ \ 


. 


College graduate 


• 




is (SSiaiaissi 


State 


■; ■ < 38 ( 3.9) ? 


? VvV 




/: . -230(2,4).'. 


. ( ' , 231 { 23) ' ' s ’ 


229 { 4.6) 


Nation 


. II | :ii«! 6*2.9) -7* < < 


v< *, t € ' ,"46(2.7) , % 






: '22 4 (2,3) 


h ;/7 J V223<T3) ; ,cv> > 


BilliiiiiiiSlIill 


Some ed after HS 


2 / (’ ' - ■* , ' K 


llifpii ■ i: i i ! i i. 


, era j a ” ; 'V -yy 


State 


: si : 35 ( 4.|fein«SS 


1 4S{4 9) s \ « 






4.7) r 


, ^226<U3) - ? 




Nation 


i i i 




^t9(33) -.Cv- sjn 




WSStemskr. liisjttecfr i .>•/?; 


r/: ^;;^22s(2,9)^ ;; ^ ■ 




HS graduate 


r 


r ^37#3)'-'r . 




State 


^ i: si 


20 ( 




i®nss«^3Si)P' : nag 


^220 < ,3.7) s ' ^ 




Nation 


r : : ;f 


N* ^'K <v - A?i 3,3) 1 i: . i hi 






202 V; 


208(2^) 


:• 215(5^) | ; : ^ 


HS non-graduate 






■ . ; ■ ■■ ■ 


State 


- &V i ■ .--I \Mm. * ■ 


*. *. 3 5 s»flr 6.3) 3 


j: ; I * * . -C 










Nation 


■ 27(3 3) . 

4S):,.. -yi/r 


52 ( 3.3) 
192 ( 4.9) 


. 'J ■ ,■ \'y -\ ; * •» : j** :n e; , j • : :: f ; 


1 don’t know 


|:f| : : 3|||pg|| 1 1| | ||||§ 5|||| || 


. 




State 


40 ( 3,8) 


. 43(3.1) 












Nation 


3$ ( 29} ' ■■■ ’ V 


48(3.0) 


. \ 17 ( 1.2) ' ; - : 




200 ( 2.6) 


Wm 


206 (4.1) :|| 


GENDER 








Male 


-C" . "li )' £1 ' : ^ i i: "H V 




:■■■ : ‘C 


State 


39(4.0) 


i c 


:::.C'V :v:.; :: ifii < 2.T> nn-C 




\p .y ^21 s$£3)# r* ^<1% 


221 { 2.0) 


nn «^eips) 


Nation 


'33(2.?) : ■ C; 


' . 47(2.7) - (C 






208 ( 22) 


.• 5| 


, 207(3.7) 


Female 


: r 7. : a ; ::i liar ■ 


: : C: : .x : C: ; . : s : ; i : ’ . * C ” : * . 




State 






2.6) - ; 






226 ( 1.8) 


v : >: 1 a 228 ( 3.1) ' g ^ 


Nation 


® i w,V *1 




• : ; 18(2;0)V: 1 











The NAEP reading scale ranges from 0 to 500, The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic, *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.4D 

Public School Students’ Reports on Talking With Each 
Other About What They Have Read 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 




1994 






TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 
State 

Nation 

Hispanic 

State 

Nation 

American Indian 
State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 
State 

Nation 


13 ( 0.8) 

218(2.5) 

17 ( 0.7) 

202 ( 2.0) 

■'■'i/'i? :<* ‘ v 1 - 

12(0.9) 

223 ( 2.9) 

218(25) 

»<«, 

“* ('*••) 

23(2.3) 

181(4.5) 

18(25) 

(**.*> 

22 ( 4.0} 

*) • <CUi 

< )('< ’'iw '/ A V '>$ >'/<.? S' ? 

- v.~ , v .. v * , " --s-- v s ; 

21 4 ( 51) 

19 ( 1.1) 

IIIII11 192(2.8) llllllllilf 
■Am-, t .'.TT5 .'*5*7 T-- 4-12 4 

aiiitttiiisai 

iiliilil 

nts 

- S' - -'-51 ,S i-*.X i?\s ' ■ ■ 


Percentage and Proficiency 

28(0.9) 

221(1.9) 

30(0.6) 

21 3 ( 1*4) 

28(1.0) 

226( 1.9) 

30 ( 0.7) 

222 ( 1.8) 

' 29(35) 

206 ( 4.7) 

32(15) 

190 ( 3.4) 

f'v'ly '1,:., 29,<2.7)' 1 - 

200 ( 52) 

30 ( 1.7) 11811111 

■l. : ' ’^#216(3.1) 

§§ff-|« 29(1.1) ■ 

SSMillSIilillll 

lllilll 50(15).. 1 Mill 
2'18 ( 2.3) lllilll 

27(15) 

221 (2.6) 

31(1.0) 

■ 111 215(3.0) 


59(15) 

225 ( 1.6) 

53 ( 0.9) 

I 318 (1.3) 

■ill lissiii iiiiiiisiiiiiiiiiiiffii 

■ ; 'Vi ' ; 7 c £<?', v \ s ' rt , ;'s 

Pill 

225( 1.3) 

■ '->1157 ( 35), 1: j 

212 ( 3.7) 

45(25) 

207(3.5) 

56(4.7) 

lifiiiiii 1 

, ' , 1 " "Uhl 

220 ( 3 6) 

l lifiili 2 (i5) 111 iiliilil 
111 l!SSjli!ii jljl IIIIIIS!!! 

mrnm 

III 61 (:. 1 -5)' :; l|l : il||i 

226( 1.9) 

52(1.7) llllllllli 

218(2.2) 

s*, % 
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TABLE D6.4D (continued) 

Public School Students ’ Reports on Talking With Each 
Other About What They Have Read 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 








Percentage and Proficiency 




PARENTS’ 


' T ' ' ~ ' Til ~ 1 l 








EDUCATION 




i 






College graduate 










State 




1111 


28 (: i;6): = - 


111^^^60(2.0) 1 : c 7'l 




'' >222b(:3.9) 




1 11" ' 


•1 ^aaS> 


Nation 






IT* 










ll i &H 4 


227(1.8) 1# 


Some ed after HS 






i ill; * JT »|f 4 jj 




State 


-4-."' “.'Is 




Ills 1 


ilEJlfSS 








PSIfiS: 




Nation 




l , 








211 ( 4.8) : 


■ 




' j ■ 22^{Sp) : 


HS graduate 








: ■ -V-:.; : : : : I;: : ;.4;?n:4;3:4 ■ ;V 3 14 ■■);■: 


State 


9 (J.6) 




31 ( 2-9) 


60 ( 3 Ayy&;£$%'A 






■ Vl>! 






Nation 


■ 20 { 1.8) ' 


1111 








* 202 ;* 3:8);^ ' l 1 :; 




205 (S%l54K2f : ;l 




HS non<graduate 


lllTT: jri. ■ j: ; i : ' : : i'i -- ;-;:\v::(:l.l: : T:i 


Tl; 




iii i ■ : - in • ■ o H‘ii i 


State 






lilllill .34,(5,3) SaiSf^l 










i iii3:7 1 i 




Nation 


20(2.4) 


4( 


y t - ip T 31iC3J7) ft $ ; 1 s 


ilMllltWil (ill 








191 < 7.1) : 


XW?S; :'.493 ( 4.3) i , 


1 don’t know 










State 


'|fti IftSliSt i 




I ; 27 ( 1 .4) '.11 ^ ^ 






'^w::W^o^^P$4. v r. 




f&J ' ' '213 C2.'3) V '< ' ' 




Nation 


A k!7 883 




lixA&Sv&TW) 






. . .195(2.9) 






210(1.7) ' 


GENDER 


T 1 . 








Male 








Kill'' 1 ^ p 1 1 i ; ; ::: r ■ 


State 


Siili! 












;.Q.; 






Nation 




. 


27(1.1) 


, #ii 




1 ric 71^1961 




.206( 1.9) 


213 C 1.5) 


Female 


. c ' \ ' 




! . : - 


. 


State 


13 { 1.2) 












111! 




230(2.1) - I 


Nation 




1111 


1 33(0.8) 






■ v ; 









The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.4E 

Public School Teachers’ Reports on Asking Students 
to Do a Group Activity or Project About What They 
Have Read 





Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 


TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 
State 

Nation 

Hispanic 

State 

Nation 

American Indian 
State 

Nation 

TYPE OF 
LOCATION 
Central City 

State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 


221 ( 4.6) ; = 

'1 Xx. ( 8(1.6) 

f 224 ( 4.4)1 

; ; / ' , ; \ 221 <5.9)1 

1111 5(1.6) c:--; •; r : 

'.7(1.9) 

: '<s$r< i m tm 

A : s if f P: P!- : : :i f v: 

Pa ;/f * ? ■ ■■ • ' -A 

4*b 

i* v*rtT.*).i * : p 
(PPM;- :A':: :■ ipiftWAK 

fftllll lltiiill flit 
81fl|l I! ® ( 2-2) |8li| 

: : X ;p99(6^ , I;:*:,,p/|. 

IS® 15 (5.6) f III 

ris 

: lasaii it 

:p.;! i iji ip i': : f 1 s A 

|||| pi||| I i; | ? i||i 0i 


Percentage and Proficiency 

a 36 (3,i) J’p," 

% % ■ yum (2,4)7'^ta^ 

issipiP* o) 

36 < 32) ' ■ 

S3? 

f £ :y^2s:i'32f''% i -y \ 

yy : -~y 222 < 2A) 

36-("4.4) RlSliS 

194(3.8) 

36 ( 4.4) . 

203 ( 3.9) 

'^MfS ^#26$ 5W^ <1 && 

■ iim . | 

: fi" ' 38 ( 4.9) 

71 Sw* < 

> ji ; r22 { 3.4) | } t 4 s» 

;208 {5.2)\ g|g| ||| 

llliBIS Ks^iKcpBMiS 

'30 118! 

SillllSi? 0 '^; 'ft 

4.i( ccVKtf 

;J«223 

f < &4@ 132 (*6.2) - f S <C 

210 { 2,4)! 


usm 

■*1 

; : . ,-.v ; i ; : p: : _ - 

67 ( 3.0) 

jSiS 

66(2.6) 

190 < 2 ' 6) 

lii: 203 ( 3:1 1 

V'-Xht 

201(4.7) 

2i° 1 m 

72(3.6) : 

204 ( 2.6) 

A , 43(8.4) / 

225 ( 3.6)1 

- ^;>;65(,3i) /.;V 

m 22HW)-- iAf 

immmmBsmsmmmm- mmi 

61 ( 4.5) 

^3 (18) 

66 ( ©-1): 

V, ’--piKZlSAZJB) .; ; ■£&. i 
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TABLE D6.4E (continued) 

Public School Teachers’ Reports on Asking Students 
to Do a Group Activity or Project About What They 
Have Read 





Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 


PARENTS’ 
EDUCATION 
College graduate 

State 

Nation 

Some ed after HS 

State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 

State 

Nation 

1 don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 


226 < 5.0)!. 

SBtiMM-Q) 1 f 

flfillill 3 ^ ; 

7 ( .2-0) 

>y. i v 

■ - 

4.( 1;7) 

js, m 

216 ( SlHflHBH 

• - ■ ' : ■ 2odi^!g|«g|p|i 

IlfSlfiiliiMiifti 
m ’-S) ■.:■■■ -y.s |ii 
ill fig® v&msmim 

202 ( 6.6)! 

HB 8 *" BjWPiHM IBl ys 


Percentage and Proficiency 

' 38 ( 3.0) - 

fit J22&423P:^$- 

3d® 3.0) 

: u 3 1 

SI Ilf i 

34 ( 4.2) j ! 

4-^%Yf^220^ZJ2) '' ' " 
S§lp?ftp2$®ii) 

205 ( 4.4) l , 

18 ( 4.4) 

• "vS:-.. 29(4.7)' . \ 

j§ P | | 187 ( 6:3)1 ,♦ glUpl 

8 ' 35 ( 3.6) 

SPM2T P % 

mmWM, 27 1 2.4; 

205 ( 2.9) §||® 

liS# 

37 ( 3.3) 

£§ J226;{'2.4)1 


" »j:3S3JS&5 £ t » s ' HHBS '' 

- • • -r.Vi 

Si Sfsii S 8 :'■•■ ■•: 

r-:- 

66, (:2|9h,, 

r;i.v‘*4*223 (1.7) - *' >, r s 



' - ' . 

- :| 7 

|i‘8S?Pl220 (13^)^ fr.-.-i 

■it 

lllll : 212 < 4:7) j ' 

56(4.0, 

214(2.3) 

206 ( 1.5) 

217(19) 

67 ( 2.4) 

r : 55(3.6) ■; . 

«pHWa^t«v^ - 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.4F 

Public School Students’ Reports on Doing a Group 
Activity or Project About What They Have Read 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 




1994 






TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 
State 

Nation 

Hispanic 

State 

Nation 

American Indian 
State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urb Fmg/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 


|H| ; 198(1,9)1 ^ J 

11 (1-0) 

.■ : 21;8 v (j2=3)^Vr^''^^ 

;i£ { 0 . 6 ) \F >V; 1 

210(2,7) , 

' e/ I--- - 11 (2,0) 

U&Mk rn&{ i-8); ;% $ k; 1 
li»BS8Si l:79*<4$) ^ ii- 

i 

21 ( 2.7) / 

ill 

‘£ 4 . : ;> :F; ‘ij-;.. £*-;=; : < ■ : j v* £ i S : j ££ 

• 13 (2.3) :ft iSSSSl 

E ; 206$%4)i/'\' 
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TABLE D6.4F (continued) 

Public School Students’ Reports on Doing a Group 
Activity or Project About What They Have Read 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 






PARENTS’ 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 
State 

Nation 

1 don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 
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Percentage and Proficiency 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.5A 

Public School Teachers’ Reports on Asking Students 
to Read Aloud 



Almost Every Day 



At Least Once a Week 



Less than Weekly 



1994 



TOTAL 

State 



Nation 

RACE/ ETHNICITY 



White 

State 

Nation 

Hispanic 

State 

Nation 

American Indian 
State 

Nation 

TYPE OF 
LOCATION 



Central City 
State 

Nation 

Urb Fmg/Lrg Town 

State 

Nation 

Rural/Small Town 
State 

Nation 
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224 ( 3.6) 
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55 ( 4.1) 
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Percentage and Proficiency 
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TABLE D6.5A (continued) 

Public School Teachers 9 Reports on Asking Students 
to Read Aloud 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 


PARENTS’ 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 
State 

Nation 

1 don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.5B 



Public School Students’ Reports on Reading Aloud 



Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 
State 

Nation 

Hispanic 

State 

Nation 

American Indian 
State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urb Fmg/Lrg Town 
State 

Nation 

Rural/Small Town 
State 

Nation 



:■ 42<vi.e)j; y >2! 
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■ 49 ( 4 . 3 ) : ' 
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Percentage and Proficiency 
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TABLE D6.5B (continued) 

Public School Students’ Reports on Reading Aloud 



* 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 Trial State Assessment 


1994 




a. ..*■ \ t ^Percentage and Proficiency . .. 



PARENTS’ 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 

State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 

State 

Nation 

I don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.5C 

Public School Teachers’ Reports on Asking Students 
to Read Silently 



1994 Trial Slate Assessment 



Almost Every Day 



At Least Once a Week 



Less than Weekly 



1994 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 



75(3.4) 

223( 1.6) 

- • i 



White 

State 

Nation 

Hispanic 

State 

Nation 

American Indian 

State 

Nation 

TYPE OF 
LOCATION 
Central City 

State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 
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Percentage and Proficiency 
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TABLE D6.5C (continued) 

Public School Teachers’ Reports on Asking Students 
to Read Silently 



Almost Every Day 



At Least Once a Week 



Less than Weekly 



1994 



PARENTS' 



EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 

State 

Nation 

I don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 
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Percentage and Proficiency 
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*1 217 ( 2.4) 



mmm 



2(0.7) ;| 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.5D 

Public School Students’ Reports on Reading Silently 





Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 Trial Slate Assessment 


1994 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 
State 

Nation 

Hispanic 

State 

Nation 

American Indian 

State 

Nation 

TYPE OF 
LOCATION 
Central City 

State 

Nation 

Urb Fmg/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 
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TABLE D6.5D (continued) 

Public School Students’ Reports on Reading Silently 



Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 



PARENTS ' 



EDUCATION 



College graduate 

State 

Nation 

Some ed after HS 

State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 

State 

Nation 

I don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 



' \ / ' ~ ■" : 
■' f.. ?$£ 

-y 

^66 ('<1*6)411 

'M i 

231 «2£) 

: 227 ( 2.4)fJ 

sw^jfts - 

60 £2:1)1S: 



a?* 

If.; 198 ( 4.1) 

70(2:1) 

V' • . 22lj((2ilfe 

63l'ii4p& s! 
' °v 2i3'(^i rh® 









--'jo.' Vi! ' ■- 'V 

W® 

y .66(22) 

224(1^)", 

i: '< M V ' ‘ *• 



UMi 




( 1,2} 
. ; ; , 224 ( : 1 .4) 



Percentage and Proficiency 



20(1.8) . 

8222^3 JStfm 

<22(3.0) 

||s^[|^);gg 

23 (2.7) 

22315-6) ' 

206 < 3#Jjjg5 j 

islii)! 

16(2.8) 

• Hr* 

20(1.7) - 

&t3l(p5)!|p 

lpip£)Y" 

; ^57; ( 2.9) 



21 ( 1 . 6 ) 
221 < 2.7) /' 

208(2.1) 

21 (1.5) 
224 ( 3.3) 



: ' r;< 

Mf 



lIMolf 1 i.3)£ 




. . ( 1 . 8 ) 

• **♦ /*• *\ 



Hi490l( 4.5) - •: 

llfiil'3-3), •“< 5 

*•* /♦* *\ 

.. - i. I 

mWMUl * ««§ 

: 'i^'MP^l4)PR5! 

192(5.0); - 1 

^Kfii-o).; 

|«gflsK<a2) ' 






jgmm .. . 

;207|(?5I7)$W 
IP»010.7) 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.5E 

Public School Teachers’ Reports on Giving Students 
Time to Read Books They Have Chosen Themselves 



Almost Every Day 



At Least Once a Week 



Less than Weekly 



1994 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 



White 

State 

Nation 

Hispanic 

State 

Nation 

American Indian 

State 

Nation 

TYPE OF 
LOCATION 
Central City 

State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 



Il|:'69|i3^i 

|524;^p:€)A 

ip9|^5)t 



lplR3:3) J 
f22B^J5Y- 
S f 7h (3.2) 

223 (1.5) ! 
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203$3^t| 

20JP&) 
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|208;(3.0) 

74 ( 7.1) 
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221 ( 2 . 2 ) 

' I ; 65 ( 4.1) 
226 ( 2.0) 

216 ( 2.7)7 



Percentage and Proficiency 



I ^219^2:6)| 
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sf222 (*2,8). 

208 ( 5.6) 
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;-V>189;<'3.4)| 

iieSiSHI 
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: 22(4.1) 



: : :: -TS r*.') ■ 7 
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.. -ft > 24(6.4) : ,, 

I 24(3.3) , 

221(3^) 
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WBMMM22Q (‘3.0) • 

210(4.9)] 
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TABLE D6.5E (continued) 

Public School Teachers’ Reports on Giving Students 
Time to Read Books They Have Chosen Themselves 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 






1994 






PARENTS ’ 




Percentage and Proficiency 


llpll 


EDUCATION 










College graduate 


■Hi^M ffUilllii 








State 


' ■$ 3 


25 (3i) 
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L, 232{.2.0) r ' ; ' , 

. 7o#«) : srMM 


227,(3*4) < 
' t ,23 £2.3) 


l 


*** 

7 ( 13) 


Some ed after HS 


:£ 225 ( .1.5) | .• ■ 








State 


1 1 70(4.3) '\b 


27(4.1) 
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llBilll iiigi miji | 
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9 (,3.3). , iK i' ^ 
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(M) ■ 


; | 


; 6 ( 1.7) ; 1 
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• ■ '■L'? v " ■■ ■ 


. : ; i tt ** ^** .' !- 1 ' ■ ; 7 : ■ ^ , ; ; j ! - 


State 


65(4.4) 


* 




;|#f ; . 4 Of) 
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* 222\<‘2.6); 

hm 

209(2.4) 


30(3.2) 




7 ( 2.0) ? ; 


HS non-graduate 






: j . : f, ■■ ■ | ! '"*?(*i:*) j % ?? 


State 


58 ( 7^i|ll|||l 


32( 7.4) ‘ 




■ 11- V4A) 
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fc , sSfoiS ~< &p|g 








1 don’t know 




^^8*^91(18^1)?? 


llllllll! 


< ■ Ji$p$c ’as 


State 


68(3.7) 


"7 28(4.0) 




S : 5(1.7) I ■ 


Nation 


, , 216(2.0) 


l|^5^SiSliiV<ISC5) ; ;s 
MBpapSTtfgateij 


- - 


: ? 3-...? < •** ^ .. | vi; ? v? y. 


GENDER 


. 207 ( 








Male 


■ 


! : , . ' r.:: ' ■< *: :> i : v. V v ^ : : - ♦ 






State 


lillilpS 68 (.3.4) | |llSl| 


SSI ' 27 ( 3.5) i 
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tyc&s*: §1® ns 


|lig§^&(2.9) 

W&W^€(|2Sy|' 




***, ( *4 *\ 

6(T1) 


Female 


' 210 ( 1.4) : 


203 




198 ( 5.4) 


State 


70 ( 3.4) 


■7 .77-:-;: ,,26':(:3.5) - - 


BlSSlSi! 


4(1.2) 
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-V«: : 230(1.8) 


i-V . ' 26 ( 2.6) 


3 7^ir' 


m (.. .) 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.5F 

Public School Students’ Reports on Reading Books 
They Have Chosen Themselves 



1994 Trial State Assessment 



Almost Every Day 



At Least Once a Week 



Less than Weekly 



1994 



TOTAL 



State 

Nation 

RACE/ ETHNICITY 
White 
State 

Nation 

Hispanic 

State 

Nation 

American Indian 

State 

Nation 

TYPE OF 
LOCATION 
Central City 

State 

Nation 

Urb Fmg/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 







/jeiKfiiBg 

231 ' < 1 - 3 ) 
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229 ( 1.3) 

53 ( 3.7) 
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mm ( 32 ) 
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Sf 52 «^ 5 J@ 
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230 .( 1.6) 

53 ( 2.4) 

222 ( 2.3) 





Percentage and Proficiency 
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U lie), .1 • l l|i IIS 
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3|flS 30 i 2.6) 
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;Tj9) * ?• 
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illllll - i ii| 

200 < 4.9) 

iPMIt 27 ( 4.6) $ 
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30{i:8) 
206 ( 2.8) 
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219 ( 5.3)1 
.30 ( 1.2) 
218 ( 2.5) • 

25(1.5) 
.220 ( 2.4) 

27 ( 1.6) 

|pj 208 X. 2 &) 









16(1.1) 

; 216 !( 3.1) ' 
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. :■ 

:-::4.4 : :■ - ‘ : 

v 
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^.f(pS). 'S t ! 
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18(2.5) 

!iS20%i^)' : 4 tSz!\ 

177 ( 3.B) 

20 ( 2 , 5 ) 
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mm&mMm&m 



^ A ♦ ’I 

: 15(1.3) 
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iS 18 ;p 12 ) < ' 

195 ( 3.7) 
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IT < 1 
212(4.3) 

iilHlilli!®! 

17(15) 

Ss 3 SI(i§to) 

: 20 l(: 1 ^« 

205 ( 3.7) 
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TABLE D6.5F (continued) 

Public School Students’ Reports on Reading Books 
They Have Chosen Themselves 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1994 








Percentage and Proficiency 




PARENTS’ 








EDUCATION 




; s&s ; v „ v \ N v$ 


; : ' :: ■ • Vr';: 1 • : 'i : 2} V f ' fy ;; ■ 


College graduate 


, * "* 4 






State 


62 (2.3) 


' C26.C 1 .8) ' % / , * 


; : IIS Hill! ISII 
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•: X'P --S:- *i222'{;5.0) ” ,s: 
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' 
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3v tHiej; (3^9*4^ i S ;>3 
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HS graduate 
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- " 206l( 3;4)' ; 


^§25B|^8(4.6) 
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State 


61 ( 6.4) 


::r.:.C ; S ' ' 28 { 6.1) ■ 


11(3.6) 








. ■ ; . *** f+* ■* J - XX : . 
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II! 22 ( 2.4) ' . 




1*111^1161(16.0) 






1 don’t know 
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[ : xi : lxx x -x ■ :|X; ;X ; : ; X ■ XX :X|-X' ■ x XX; X; ; X : iX ;X:XX XxX X;>;.X X; xXxx:X;X; X;’X| | 


State 




ISII : 25 ( 1.6) 


1 1 i m 




220( 1.9) 




209 ( 3.9) 
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l4| 










4 U 2»)Ja i%: V ft 


GENDER 






' " - , ;i : ; ~ ' 
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• 




■ - ' / v> .. 


State 




; :24 < 1.5) Jit fit 


. 20(1.3) 




; 4 jgji 






Nation 




30C1I3) 






X*: i 


“.206 (.2.0) 


1< H'4X fl> 
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v 3 1 4 flf# ^ 5$pfS!^ ^ 




. 


State 




jx26;(U 


13 ( 1.2) . 




■■ 231(1.5) . ^ 




BBlMsi ' i 


Nation 






15(0.8) 








HI C v 212 1(12.7) / 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 



3 

ERIC 



171 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



171 



Montana 



THE NATION’S 
REPORT 



CARD 



rcaep 

§ 



TABLE D6.6 

Public School Teachers’ Reports on Sending Students 
to the Library 



1994 Trial State Assessment 



At Least Once a Week 



Once or Twice a Month 



Never or Hardly Ever 



1994 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 



White 

State 

Nation 

Hispanic 

State 

Nation 

American Indian 
State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urb Fmg/Lrg Town 

State 

Nation 

Rural/Small Town 
State 

Nation 
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Ir^( 1 :8) 

214(3.4)! 

9(1.8) 
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9 < 3.7) 
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214(3.8)1 
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TABLE D6.6 (continued) 

Public School Teachers’ Reports on Sending Students 
to the Library 



1994 Trial State Assessment 



At Least Once a Week Once or Twice a Month Never or Hardly Ever 



1994 



PARENTS' 



EDUCATION 



College graduate 

State 

Nation 

Some ed after HS 

State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 

State 

Nation 

I don’t know 

State 

Nation 

GENDER 



Male 

State 

Nation 

Female 

State 

Nation 



' , ' 't f - ,. ( \ '' « 

|li| 92 |frtJ 9 ) ' 
Ii 231 '<:i- 8 ) ; .v.; ^ 
. as ( 2 . 2 ) •: 
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Percentage and Proficiency 
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7(2:0) 
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5 ( 1.6) 
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216 ( 4.7)1/ 
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ll .. I 3 C 1 . 0 ) V - 
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_.L/' i 



_ , : -- - - 

3(0.8) 



191 ( 7 . 0 )! 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). Percentages may not add to 100 because a very small percentage of teachers 
reported that there was no library at their school. ! Interpret with caution — the nature of the sample does not allow 
accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.7 

Public School Teachers ’ Reports on Assigning Books 
from the Library 



1994 Trial State Assessment 



At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1994 



Percentage and Proficiency 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 
State 

Nation 

Hispanic 

State 

Nation 

American Indian 

State 

Nation 

TYPE OF 
LOCATION 
Central City 

State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 




; .;v 
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TABLE D6.7 (continued) 

Public School Teachers’ Reports on Assigning Books 
from the Library 



1994 Trial Siale Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1994 


PARENTS' 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 

State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 

State 

Nation 

1 don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 
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lliillll ■ -’ 777771 

•MM - ■ 221 izaymimmm 
|p -'1'% 1 

209 ( 2.6) 

23 ( 3.5) 


| | 4 0 j 

13(2 6 ) HI 11 

^ 15:8 
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. . **'(**.*)::■; - 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). Percentages may not add to 100 because a very small percentage of teachers 
reported that there was no library at their school. ! Interpret with caution — the nature of the sample does not allow 
accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.8A 

Public School Teachers ’ Reports on Assessing Students 
Via Multiple-Choice Tests 



1994 Trial State Assessment 


Once or Twice a 
Week 


Once or Twice a 
Month 


Once or Twice a 
Year 


Never or Hardly 
Ever 


1994 


TOTAL 

State 

Nation 

RACE/ ETHNICfTY 
White 

State 

Nation 

Hispanic 

State 

Nation 

American Indian 

State 

Nation 

TYPE OF 
LOCATiON 
Central City 
State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 


: ; 7 * - 

.-i.C-a'i) 

lllllji:223 (i4.4)i 3$ -ii 
12(1.9) 

211 (3.1) 

■ ■ 

6(2.1) 

228 ( 4.5)! 

11 (2.1) ' 

222 ( 3.2) 

‘'’."S'," 

7(2,8) 

'' 

ilsilil 12(3.3) ' 

192 ( 6.9)! 

8(3.7) 

■ ■■ WtK ■ " ~ 

- 2(i^-j:»4 

10 ( 2.4) 

: : 7 

10(5.8) 

;>:r; 3 c «<<' > 7 " 
v “ <A • 23)' 

7 s 


Percentage ar 

49 ( 3,8) 
::v'22Z{A.7) 

r49:(i2j4:)i-;^ia: 

48(3.8) 

; ; :-!::r;;:227 ( 1.4) ; . 

:S 47.(;a.5) 

: ’223(2.0) : £ 

52(6,1) 

207 (3.9): . 

48(3,8) 

189 ( 2.6) 

49 ( 8.5) 

i 205(3.7)1:7;; £ 

42 ( 5.5) 

' :'7-i 

61 (9.0) 

111 - :S ;222'(Jk7), 

55(3.6) 

'. ! 201 ( 2.8) 

;T>->45(11.2) : ; ; 

: 40(3:3) , 1 

HI7 46 (-4.5) .. • 7 

>> V-S222.<”£4>;'-‘ 

56 ( 6.2) 


id Proficiency 

21 ( 2.8) 

221 (3.3) 

. mi. 1.?(,1(5), 

216(3.2) 

7 t. , * ,, \ *4% 

21 (3.0) 

224 ( 3.0) 

18(2.1) 

.. 1.1 .222 ( 2.7} 1717 
24(4.5): 

***r-*> 

18 ( 3.5) 
197(5.7) • 

. / 15(4.8) 111 

II 1131 

31 jg r.*5 7 :* ' * 

A f ■ 1 MpRv 

31 (83) 
■214(6.6)! 

5 

7 ? 211 (7.7) 

'■ ■' : ;■ : : 
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- ill Wm, i ■ WHMi IS 
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1 ;- 16X3.6) 

v. -^219^4)1 g 7 


1 |P0>f i 11 i-HI 
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■l. ’ x > •’ > : '•Mr* it**. <* y J j < > 
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-if 

() . 

. -i: 7? 
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~ r-') 
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209(5.4) 

! 1 '-, 
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TABLE D6.8A (continued) 

Public School Teachers 9 Reports on Assessing Students 
Via Multiple-Choice Tests 



1994 Trial State Assessment 


Once or Twice a 
Week 


Once or Twice a 
Month 


Once or Twice a 
Year 


Never or Hardly 
Ever 




1994 






PARENTS' 
EDUCATION 
College graduate 

State 

Nation 

Some ed after HS 

State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 
State 

Nation 

1 don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 


■ 

■ 

„ io(i.6) 

216(4.4) 

. 1 0 { 2.0) 

208 ( 5.2)! 1 ; 4-; 

>;V. 1 

fig ■; : : ? fc s 

IPlSlI 6: ; (Ti9) : ' 
t'0* If 

205(3.1) 

6 ( 2-2) 
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- ;p 

: > « 
4i* 

Sff| p^p9): m B 

207 ( 2.5) 

57 ( 7.2) frff 
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Y;Y - ' -■ y: \ ' f ■ 

HhnI 

;; 190(5.0) 

y: 1 49 { 4.0) ; 

PW^AS'X 2,5)^tf:J 

. 204(2.1). 

■ 

Y ; Y 48(4.1) ■: 

: \ 207 ( 2.1) : ; Y; Y : 

: - : Y ; -- : Y V :49Y{:'3.S) ' Y ' : l : ; 


id Proficiency 

20(3.1) 
227^3.7) :#■ 

17 (2.0), 

i 20 ( 3,4) Hil 

*♦* »|j 

17(2.8). 

>V ^ f^218!( : 5;2) 

IS® 19(4.2) 

•kit* 

18 ( 257) 

tl||t 12 ( 4.8) : Y - 

... : Y“("')Y yy :Y : 

24 ( 3.1) Y 

S^C&Zjrf, ' 

207 ( 2.9) 
20(2.9) 

; 209(3.6) 

21 ( 2.9) 

226 ( 3.7) : - 


*r« it: '■ MT& 

lilfflllllllliilSIlllll 

23 ( 3.5) 
234(3.4) 

Hi 

YY; : P :■ tm ? 22 .: (.4 .0) p.£. :YY|Y 

III iiiipifcpp ij 1 

219 ( 4.9) 

Wi#83 

■ 208 ( 5.2) Y 

29(5.5) 

gJi§ 

22 { 3 1) 

207 ( 2.9) v 

>■/ v - fS ; ; '"/K jy. 

24(3.5) 

; 220(3.1) ii 

210 ( 3 5) 

227 ( 3.4) 

#^ 22 '(« 2 S), ;rr -r 1 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.8B 

Public School Teachers ’ Reports on Assessing Students 
With Paragraph Length Written Responses About 
What They Have Read 





Once or Twice a 
Week 


Once or Twice a 
Month 


Once or Twice a 
Year 


Never or Hardly 
Ever 


1994 


TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 
State 

Nation 

Hispanic 

State 

Nation 

American Indian 
State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 


;j sfa - : 

. ■ m.l- . 

38(3.6) 

• \ 39(3#) .-fe; 
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■L - ,',34^ 5.7} 

34(4.8) 
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A"* < ' v' . 'A — ' 5. S i 


Y Percentage an 
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|||ffe45J(32):i^|| 

1 H- 45'(1^:C5^ 
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4 V. >45,C3^) 4 < : ■* 
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(111 47(4.1) 
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fry^99( 6 . 2 ) ;,® 
|pgl«|g|^p!| | || 
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' &f P218i{ 4S4)^SIS» 
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?S*22S( &9) ; 
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42(5.0) 

• v f^12is^3^<^^r 


id Proficiency 
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iiSra®*) n 
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p-’-v if ;,■•:■ : 
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liW-TSCV).: $h 4 

p Jfy, ¥ ■ ; £ /ft i *• >>7'"- 
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J (,3.3) 
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— (-.•) 

.'A 
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1 1 IIP213T - 6 w»i^ v ^ -Vi 
S 4 41 « v ^ 


201 { 3 . 8)1 

8 ( 2.3) 

,£ .219 (.4.7)1 |p,,, 
209 ( 3.7)1 

| §s| 

•••r-n 

9.(34 

9 ( 2.9) 
192(4.0)! 

217(9 4)1 

211 ( 5*4)! 

201 ( 47 ). 
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TABLE D6.8B (continued) 

Public School Teachers’ Reports on Assessing Students 
With Paragraph Length Written Responses About 
What They Have Read 



Once or Twice a 
Week 


Once or Twice a 
Month 


Once or Twice a 
Year 


Never or Hardly 
Ever 


1994 



Percentage and Proficiency 



PARENTS’ 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 
State 

Nation 

I don’t know 
State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 



Hill 
8 i®l 



vS*':-':' W. 
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228 ( 28) 

38 ( 4 - 4 ) 

: • 218M4-.0) j. f 

ms/ ■ ■■ . : 
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' - C~ < '< ' ''i„ f / l '■<? * vi 
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Ai 
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-A "'ll ( 2.4) 
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SiSi iS)||^J|! 


r 3*}. 
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41 (4.1) 
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y > \ ' i ' <5%^ < 

w0imm0 BPil 

> 213( 6.2) 


. ^ 41 (6.9) | 

f# MiffiiW 
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l| 19 ( 5.2) ■ . •••:• 

> 3 12( 2.8) \ ; : 
■ \ “Tv) 


V-d 43 ( 38) A ? 
207 (2.1) 


'ri: . 12 ( 2.8) 

TfrS&W 1 

202 ( 5.1) 


llt§ffi3 i s:s)\m0: 

- 208 (1.8) ; | 


MM 

Sffllfl 9( 1.3) r 

J^;210~(X4) : : 4 


42(3.6) 


12 ( 2i5) 
10 (1.7) 



0^0 ' \ 

SII1S81II 

- - 9 ( 2.5) ■ 
220 Cil4)I 

I Sll(g3^ 

209l(^)ft 



: ■ i 1, : 

: 1 



■ a . 



Ad 



lef 

|p| 



- ;■ ' 10 ( 2 l 6 pili 

. / \ ^(1-4) 

II mg 1 1 

issiii isn 

*** 

. ■ v * } 

3 ( 2 . 6 ) 

;20%%.9)!X«S 
• i ft 7 ('1:7)' J 

192(4.3)! 

10(24) 

206 ( 4.3)! 
a 7{i.4) 
195(4.8) 



PSSSSK^Ilffe 

Illii2^l(i5i6)!iai ... 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.8C 

Public School Teachers’ Reports on Assessing Students 
Via Reading Portfolios 



1994 Trial State Assessment 





Once or Twice a 
Week 


Once or Twice a 
Month 


Once or Twice a 
Year 


Never or Hardly 
Ever 


1994 


TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 
State 

Nation 

Hispanic 

State 

Nation 

American Indian 

State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urb Fmg/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 


'••4 •* y- 

19(3.0) 

222 ( 3.0) 
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- J 

■ ' : v ' f 
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v 217 
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; 29 ( 6.6) 

203 ( 5.4)1 :iv; 
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.*** 
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i 
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M 229 ( 2.3) ..vl 
-4glt16(Z2) ; >"> 

_ 4';, 224 (312) ■ j 

17 ( 4.6) 

"**(*'•*> 
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'f.”' 20t^( 3.7)1 ,1. 

- ’ f -■-4 "1 : 

4 : ' *16 ( 314) 

: •** <**.*) 
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h;-- :^V: $ 
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'205 ( 4.5)1 

2JB) ' '' 

226 ( 3.5) 

226 ( 3.4)1 
; v! ; 205, (-3.7)1 


40 ( 3.6) 
222(20) 

43 ( 2.5) / 33- 

214 ( 1.8) 
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( 3.7) : :;SSflif 

225(1.8) 

46 ( 3.4) 

222 ( 2.0, 

38 ( 5.7) 

207 ( 6.5) 

35(32) 
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38(7.7) 

lf:|5 ' . 202 (419)l|,:#i§| 

39 ( 5.8) 

10W 

'* w ; 'S',.'. „> 

- 4 •' ' , :.f f —5 

219 ( 52)! 

207 ( 3 5) 

25 ( 7.0) 

r-*) 

40 ( 4.4) 

221 ( 2.5) 

222 ( 2.4) 

57 ( 5.1) 

212(2.5, 



(continued on next page) 



ERiC 



80 



180 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



Montana 



THE NATION'S 
REPORT 



CARD 



rcaef! 




TABLE D6.8C (continued) 

Public School Teachers ’ Reports on Assessing Students 
Via Reading Portfolios 



1994 Trial State Assessment 



Once or Twice a 
Week 



Once or Twice a 
Month 



Once or Twice a 
Year 



Never or Hardly 
Ever 



1994 



Percentage and Proficiency 



PARENTS' 
EDUCATION 
College graduate 

State 



Nation 

Some ed after HS 

State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 

State 

Nation 

I don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 



m 
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lOQ / & 
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• ■ 221 ( 3.0) " 

’ -' 4 : I ! : - ; ? : 7- 
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' !: f 26 ( 4.3) : : V^'V 
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■ 225 (4.9) . 

mmmm 
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’**5 230 ( 3.0)!?. -! 
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}'K-i4m -s' %>! 



' ■ 210 ( 3.8) 

. £ C'J 




kip ;: :;i3:(2.5) <$ 1 

219(4.3) 



J1 .: '• -n 

-Jii 

43(2.5, 

!lllill||ll|||llll!! 




mMvM 

2201(^1.8) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D8.1 

Public School Students 9 Reports on the Frequency of 
Reading for Fun 



1994 Trial State Assessment 


Almost Every Day 


Once or Twice a 
Week 


Once or Twice a 
Month 


Never or Hardly 
Ever 


1994 


TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 
State 

Nation 

Hispanic 

State 

Nation 

American Indian 
State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 
State 

Nation 


si 
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wti’ii 
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TABLE D8.1 (continued) 

Public School Students y Reports on the Frequency of 
Reading for Fun 



1994 Trial State Assessment 


Almost Every Day 


Once or Twice a 
Week 


Once or Twice a 
Month 


Never or Hardly 
Ever 


1994 


PARENTS’ 
EDUCATION 
College graduate 

State 

Nation 

Some ed after HS 

State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 

State 

Nation 

1 don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 


’fill 

-;55 (liisj:*',* •; 

237(1.9) 

230 ( IS) 

233 ( 3.3) 

232 ( 2.4) ; 

««2aei®3t4>s wgm 

40 ( i.6)' ; ? i 

215 ( 2.7) 

■ ■ : : : : *** ;■ /* « 

'• - 1 94 ( 4.2) 

;• ' ' ■ 

;; ; 212 ( i:4):, : :: : ; . 

; > ' 

, 'rf, 40 i 1.7} 3: 

.' 36(1.0) ; 

216 ( ’3) 

S3 ( 1-5) 

234(1. 6):3; 

■ : : ; ■ 53 ( 1.1) 1 ' : : : 


• Percentage ar 

' 28(1.6) 

... .219 (2.0) r 
25(2.8) 

ipg226!g5f0)^^g 

flBp 

< i j22L(3.5)V>f 

34(1.9) ' . , 

205(3.1) ; 

26(4.7) 

' 26 Ui) ' 

gi|| 192(5.1) g 

f WSm 'c ; i:3)f- ■! i 

m&B31 (llvl)llil : 

206(2.0) 

32 ( 1.2) 

f 1 216 (2.1) i- 

, 206 ( 1.6) 

26. { 1.3) 

W* f/ > 


id Proficiency 

|f|! sn.o) ■ ' 

10 (:0i9)S^>lf4 
-V : ?14^C3:1) xSgM 

9 ( T7) 

*** jin' 

mm$(M :v 

~ c*.*) : 

■■ : io ( i.9) 

r.n Sill 

202,(4:7)' 

: 8 (3.1) ' 

13(2.4) I 
*** 

Bill 12 ( 1.2) 

; < 216 ( 4.0) ; l 

'« 13(0.9) 

, 200 ( 3.7) 

12(1.0) 

15 ( 0.7) 

202 ( 23) 

MSiii 8 (0.8) . 

r: # 


■ 1 1 1 i<|Sl 1 

210 ( 5.1) 

0.7) ' i 
205 ( 3.2) •' 

1 

fgjUJ m0§M r ' l ' 

14 ( 2.0) 

196 ( 3 3) 

. -■ 

201(3.3) 

190 (le) 

Jjj ! 1 ?! 

203 ( 3.1) . 

al*illS6p>:6)lllll» 

195(2.1) 

207 ( 44) 

7 os 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D8.2 

Public School Students ’ Reports on the Number of 
Books Read Outside of School in the Past Month 



1994 Trial State Assessment 




One or Two 



Three or Four 



Five or More 



1994 



Percentage and Proficiency 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 



White 

State 

Nation 

Hispanic 

State 

Nation 

American Indian 
State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urb Fmg/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 



31 (0.9) 

ppn <StS 

|l§|| 

... „ 

: 220 ( 1 . 8 ) 
31 ( 2J6> 

L /iv .B >i'-: 

SB 

203 ( 5.S) 

| f| ©i 



,, r .,smevm 

- • -25(1.2) \ 

Sflilif* 

sPp 33(2.3) 

®ti26p^2) f\ 

“ >218 ( 2.3) 
VLp - 

32 ( 1.2) 
222 ( 2 . 1 ) 
29 (2.1) 

2i3:dpl 



T'sy'; ' r V « v '• 

Ipiil! 

216 




^.'/37(i1,3)' ; ;|| 



■PiPSlIl.. 

•'“ $ '=%227-(» 






38 ( 3.3) 



\MWi25l&$jW0 

; : SBi229;(.1 tyllM'M: '230(1.8) i 

USB- Wfi m&.£ *"-■*** ' " oV! " r 

mmmw mmi 

. '*** (**.*) V«-: t 

amk$z&$ i £) ■&. 

, , 193(4.0) 4|- 





207 ( 5.3) Jllll 






in 



; :B.- P PB 

Ii|p222f(;3^) 

22 ( 0.9) 

i;; r ';,::'207;;(-3l6g '** 



V 



^2^Z9) 0 ■ ' 



25(1.0) (pi 



•216 ( 3 . 0)111 

i Wi mm 



\ 
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TABLE D8.2 (continued) 

Public School Students’ Reports on the Number of 
Books Read Outside of School in the Past Month 



1994 Trial State Assessment 


None 


One or Two 


Three or Four 


Five or More 


1994 


PARENTS’ 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 
State 

Nation 

1 don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 


1 ) ■ Sissll; 

. 202 ( 3.5) 

s ( 1.2) : 

IS 

. -7(1.1) :> 

♦«« 

l V ' 

fa ? 9(2.0) 

- 10(1.6) . 
8(2.7) 

mmm 

'7 ,, -9(1.0) ; 

11 : §§§§ 

|| ,9(0.8) 

- 

■-;;: v ^; r 193:(30) V- 

190 { air) . : 


Percentage ar 

v" 'wmrrrT' ■ - -"'r; • v- 

ilsflS 

-r 27 ( 1 .3) 

Si i 



vS r “AxA ! ** 

iv&Kx&ssif jfi'i) 

mmsstm/i' 

S8I18I30 ( 1.9) 
204(2.9) 

32(5.0) 

i; 

§ 192 { 6.2) ■ ■ 

' i: 33(1.7) ; V : : ; 

a®ill246lpi9):SlW*|s 

206 ( 2.4) , 

■' . Ill 34 (1.3) 

B 217 { 2.1) mMl 

29 ( T2) 

1 ' " : .' : ;226"( 2.3)- fafafa 


id Proficiency I j 

-r It?" ;v 

>7 .v^ 

% 24'XfeO) ?? 

ilS822blCS:3)l 1 Sf* 
ivfaK: 20 ( 2.2) lip 1 

210(4.1) 

1 1 'll 

: ; || 47 (2.2) |1 1? 

I §z §§ £?£> 

; ■: .1 : = 23 ( 1.5) - .. 1 

: ' ::7-'7 217 ( 2.4) 7 - f 

207 ( 2.8) 

I :<mi 24^( i.3j JIM ! 

S 22(0.7) 

25(1.3) 

.25(0.8) 


SlliiiPilPiillS 

Illllli2ciip2i8)' ' 7- >. 

liillPlBfb) - 

®li|23Sjp3iy|ill|S 

45 ( 5.7) 

:l ' i t - : _ 1 

S| 214 ( 2. 7) . . - , . 

40 ( M) WM 

207 ( 1.9) 

S(1S) . 

220 ( 2 .6) 

37 ( 1.0) 

g||g|«|fig|||^| 

. 43 ( 1.6) 

Sp^-47:(..ii), ■ 

220 ( 1.5) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D8.3 

Public School Students’ Reports on the Frequency of 
Taking Books Out of the Library for Their Own 
Enjoyment 





Almost Every Day 


Once or Twice a 
Week 


Once or Twice a 
Month 


Never or Hardly 
Ever 


1994 


TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 
State 

Nation 

Hispanic 

State 

Nation 

American Indian 
State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 


isfessssitzi) spjV, : *§. 

207 (1.9) ■' 

13 ( 0.7) 

14(2.3) 

*** ("••) 

W&m 

ft 

2 15(2.6) ; : 'S 
is ( 3.o) 

, ' s ■ 

' '[ 14(1.3) . 

17 ( TO) 

. " ' 197(2.3) ; . 

16(1.3) 

BS0i 

*■ :v: 

12(0.9) 

235 ( 2.9) ' 

rA ^>15 iiia imtiSk 


! i: ; Percentage ar 

• 53(1.0) 'III 

i^Sti-4), \\ 

47(0.8) 

:22o.{ i.2) r ' 

' ip ; 

49(0.9) 

228 ( 1.3) 

54 ( 3.4) 

: ">2>i v{;hsy:^ ; 

... 40 ( 1.8) 

196 { 2.8) 

: 50 ( £.6) ; ; 

■J‘ s>-211 ( 3:5)' 

: 50(4.1) 

208 ( 5.7) 

■■ ■:; : 50 ( 2 4) ■ 

1 

214 ( 2.0) : 

Ii§ss2ipii) : : 

1 1 

224 ( 2.3) 

55 ( 1.2) 

IgilSi 228 < -1.8) ' ' 

47 ( 1.9) 

• 220 { 2.2) 


id Proficiency 

- : i? (i.o) 

®1hB|219 (23) •’ - 

21 (0.8) - . 

i4k> v.c 

• ; lllllil 

20 ( 1.0) . 

ggs$ 

Minsk *8»: ■ , 

i, ^ i9(3.i) 

?£ 

plpa9|©.4> 

188 ( 4,4) 

15 ( 3.3) 

*+* (**.*) 

s'); . " I 

A,-. .'V ■ # , V 

20(1.6) 

208 ( 3.4) 

Pit 

209(3.6) 

' 

20(2J2) 

. ' 22,( 1.1) $ 4. 

220 ( 2.6) 

19 <1.3) ; ; 

III 20(1.4) , 

215 ( 3.0) 


. ■. . ■ 

208 ( 29) 

198 ( |l) 

: : :: ; : : : 

'mm® 

211? 

^W«P-7) ' . 

. 210 (.25) • 

|B§: s;- 

181 (6.1) 
21(2.5) 

J* %tli ***,f*» *V /4k 1 $s 

;ie(3*>, , 

*"(“:*) 's 

17(14) 

...- 206 ( 5.4) 

3® ' 

184 ( 3.3) 

T ;?> ) 

209 ( 3*31 

. - .. .18(:i;4) .; 

pPP2b4'f2^)'f|^, 
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1994 Trial Slate Assessment 



TABLE D8.3 (continued) 

Public School Students’ Reports on the Frequency of 
Taking Books Out of the Library for Their Own 
Enjoyment 



Almost Every Day 


Once or Twice a 
Week 


Once or Twice a 
Month 


Never or Hardly 
Ever 


1994 



Percentage and Proficiency 



PARENTS’ 
EDUCATION 
College graduate 

State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 

State 

Nation 

I don’t know 

State 

Nation 

GENDER 



.... . 

■ 232 CWtt...,, 

r':i7(p.8)ii|| 





g§l!0 15T5KL 

m 



Male 

State 

Nation 

Female 

State 

Nation 




, ^ rg ? : ' r;;-— 


' ' ' ** 


‘ V::’. 


i 






nJr-/ 55 (1,8) ^ 




,234'( 2.3) , 


aS«)s*.;47 - 5 


48(12), 


Wl 22(1.1) , • 


li|:. -229 ( 1.7) 


iS'i?223..('23)-' 




t.TMi 




#,i:..\i8'(aa): . 






liil SQf 3:0) 








7 ; 56; (3.0) §1§1| 


|^®*8t'2.4)' 1 ^ | 




7.}:; •'“:(*”) : &f 


llipll 47 :{ 1 ,5) 


:v:r 19(1.8) ■ 




205 ( 3.1) 


8 : : 48 ( 5-8) ; 


88 : :::':8i3 (3.8) - , 




§ p®p(#ls .‘tTS 


pfer46i(^6)J^PS 


; i9(3.i) 


194 ( 4.9) 




111 I 


2t { 1 .4) I-’-.' ; : 7;' 


221 ( ! . 9 ? m 




MiWrM 


t f £ 


: :213( 1.7) : -7 


211 ( 2,3) , 


: > 49:( 1.4)7 7 : : -.;:-7 


' ^''':72ll : 12)-^7.;7'7 




;215(Z8) 




IPPI123W1.0):^:1^ 


If!!!! 




s ii|®l i filSIlSi 




IS 1 ' 58 { L6) -}S 


iligllliliiiil 




:fj|'l||223 ; ('3.0).; . 


51 (0.9) 


*iJSfi®I(Rj]9)T"Sp:3 







!: : 7 ! 



(OS) • 

5p^219f 45) • C ■ 

K f|ffi33S0.8) 

207 ( 3.0) • j 




,201(4.2) 




The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D8.4 

Public School Students ’ Reports on Types of Reading 
Materials in the Home 



1994 Trial State Assessment 


Zero to Two Types 


Three Types 


Four Types 


1994 




Percentage and Proficiency 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 



White 

State 

Nation 

Hispanic 

State 

Nation 

American Indian 
State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 
State 

Nation 



28(1:0) 
213 ( 1.9) 
30(0.9) 
196 ( 1.5) 



25 < 1 :i) i 
218(1:9) 
24 < 1.0) 
;t208( 1JB)/ 

198 ( 4.2) 
46(2.6) 
176 ( 3.5) 

42 ( 2.7) 
200 ( 3.6) 

I 40(3.4) : 



28(1.0)/; 

215 ( 4.5) 

ll3M;i)| 

29 {22) 

216 ( 4.6) 
27 ( 12) 

27 (1.4) 

. .211 .( 2.5) 
X/31 (2.1) 
200 ( 2;6);.l 



11371(16:^1! 

222 (1.7) 
34 ( 0.7) : 
'/214 (:i:3)!; 



•;#l37 ( 0-9) ;• 
il226 ( 1.7)/,j 

ll! : 36(!6^)!:!i! 

222 ( 1 . 8 ) 

37 ( 33) 
208(5.9) 
28(2.1) 
198(3.1) 

34(2.8) 

fli2b3'i(4J2)/- v 

/>/,35(3.5) 

< v | » \ 



36 ( 22) 11 

/ 21 5 : .^ 4 : 3)111 

^3i‘'(o^)rl 

204 ( 2.5) 

38(1.8) 

226(5,1)1 

| 221 (1^) ' ' 

224(2.0) 
35(1.5) 1 
214(2.7) ! 



: - x;-' 

' • * . . ' •• . ' • 

36(1-2) 

231 ( 1.6) 

36 ( 0.9) 

mmmm" • * 




233 ( 1 .6) 



'* ■ 



40(1-2) 



1233 

32(3.3) 

217(4.3) 

2o! ( 3*7) 

f>' 24 ( 32)-A ;!J 

Irri/''/’';.. 

v- 25 ( 3.?)i j. iiiif y ■ 

**• *\ -i '< k' ; , 
O' 'V , * \"4 ' 'A 

- 

36 ( 2.2) 



|||2;||34 iP 1 ® 1 * 



35(1.7) 

217(2.6) 



v 

233 ( 2 0) 

■ 34 ( 2*0) 

^227.(2.1,) ->*■ 

\ 'k' *- ' -k 
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TABLE D8.4 (continued) 

Public School Students’ Reports on Types of Reading 
Materials in the Home 











1994 Trial State Assessment 










Zero to Two Types 


Three Types 


Four Types 




1994 










Percentage and Proficiency 












PARENTS' 








EDUCATION 




3®?IS3illIW 


|j .: : . ;.; ; : : 


College graduate 


' 3 • • 


- X> .4 ■ 1' : : : . ! ; ' 7 V ' ! f . . A ! ■ ". \ \ }■ \ t ? ■ \V/ 


b'O JwK '3 3 {' ■"'>. ; ' i . si. ; 


State 


mMmmzi 1 wiMM&y 








ir<;.3.o)^ 


;'P C 


: \c ;• ir P : 


Nation 


in wliiMPtilp] i 


33X : 1^) v C- j "T P' £ 


'1 




; 205- ( ‘ ' 4 


Cpp p ■r22(|(iijigsB^| 


230(1.5) 


Some ed after HS 


' 'V; '■ 


T : ' - W3 ^ X 3 >33 > 3> ' 3 ' 




State 


• - 


; ' ' * ' f~ ! Vl' 34- T ('3.8)?i 








?rl ^fT?224('4^) 




Nation 


24:C313)"^ C 1 


lllli i| | 1 


:32k 1^; 1 38^2.6) C; ?Pi\ 






:2 { f?221' \ 34)t 


' ; .■>■ ] i^ilsSlliSa! 


HS graduate 








State 


IIS IliSbrO 


ir; >3 " j ' v 39> ( ZS) f V ^ - 15 


31 ( 2.6) 




ills 1 1 ('3[2^Vi^ ; 


3219 < 3.7V % iil 




Nation 


SS ,1a^33 (rzo) lliiSI 


: i: IfWI 


Cf tilJc' >L 






5 f^g: 72 i 2 




HS non-graduate 


s - 3 7 


3 ■ >P>P : ^> ; f ■ 3P ■ ; 33 '3 >> ;3 - i 3-x 




State 


:'hC^S>49/ 


HS.y. i|3ST( s;6)5 








li»SI plKi^! 1 iflfii 




Nation 




^&pg27^2i2)' 


15(3.1) 






;: III! 




1 don’t know 


i 3 : 3 3p ; ; c 






State 


. 37< 1.8) : 




:V;';7- Vrl25(lJ)/ I ; ,>; 






CCCi ' ;: : ;217--(2.5)3 - : : 1 




Nation 






f%:SBl * T27(i.4)^ ? 7': ; 




p|l|| 193 1 1.9) 


209 < 1 .9) 


M«|I|(' ; 1. 8 ) 


GENDER 






I? ] .. ' " . :i ? \]Z . i V 7 : ' ’• : - 


Male 




7 Hi; 7^:3 .tv;:;:: 


: £\$P 


State 


27(1.8) 


Ir $■ \$& -St 


4(i% ^ ' ^^37 {"& 9) - v ^ 






4"V >> %mzni{ 2.3) ^ »p| 




Nation 


.28 (TO) 




i & C: ' 






208(1.9) : 


|g|j;Sf^|2p ( 1.5) ■ 


Female 


. 


! i:i *™: : : 3 : &Q 3. ! :; :s3 : : C3 ■; : ; P :^i i ii 


; ^;i : r ■ ^; ;ir ;rr : 


State 


' ;;28 { 1.3) PP^ClPii 








fel 


SSSI^ 


||B||i|pS236 


Nation 






Si ‘7.14 






^^^§:22i^t4) ■■: zimmm 





The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D8.5 

Public School Students’ Reports on Talking With 
Friends and Family About Reading 



1994 Trial Slate Assessment 


Almost Every Day 


Once or Twice a Week 


Less Than Weekly 


1994 


TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 
State 

Nation 

Hispanic 

State 

Nation 

American Indian 
State 

Nation 

TYPE OF 
LOCATION 
Central City 
State 

Nation 

Urto Fmg/Lrg Town 

State 

Nation 

Rural/Small Town 
State 

Nation 


- - 

25(i.o) ; : : ; 

rnmt 28(0.7) 

25(1.0) ' 

25 ( 0.9) ! ip 

.. 223 ('1.7) ‘->"0^7 

liiiiiiiiiiaiiiiaii! 

i.S: 

■ ■ ' 

ill ||iSSf8a,(sa^SS> H 
• M-t 

l;i ;3iT3S).- - fc&K 

mm k> 8 psniiiaflisi 

1 |1 l| ■ f. pi f| 

s is' ;V ' " ff <■>. t 

;; 25(2.0) 

30 

202 ( 20) 

30(22) 

224(4.1) . . ; ; ~ 

27(1.1) : 

% iigl 

25(12) - 

® 1 1:223(25) - 

P rr;^i4(ao)V .. 4 


Percentage and Proficiency 

BS I >s £ fifiSI & .o) ? "J ; SI 

g||#| 22L(|1;4) ^ ‘ £ 

36(1.1) 

232 . ( tl 5)' % % 

i ' 230 

111; W&: ( 4:3) "B 
: s P' " /. : 2i4;<;5.or */: 

' p . 29(1.4) II | 

( || ||| 1192 ( 4.1) IT ..I 

29 { 3.2) 

' 205(5.6) T ' i 

!! i 31 < 1.4) 1111 

33 ( 14) , ' 

j 1 1| ;P : 211 {2.6) : :p : : | !|jf| ; 

% : 35 ( 1.6) ..' ‘ - " s 

226(4.7) : 

37 (0.9) 

|. T 227(2.1) ||| | T 

37 ( 1.4) 

WMK('2.D) ' ' 

*& *> ' 34<>;i:i) m - 

223 (13.3)|6 {?:?[ tc 


.... 

. 39 ( 1.1) ' i" 

mmm&mmsmmm 

;M i^'I .208^$) 

39 (IS) 111®! 

i§? 

1 35(3.0) illill 

203 ( 4.8) 1 ; '7 

Sp H V 38,(1.9) 

t n - 

I ' l| | 39 ( 3.4) V®I1 

200 ( 4.0) 

- 

: •; j , : 

. ■ . iPfl! 202 ( 2.5) . I ig 

1SB 36 ( 2.1) : >1,7 li. 

r; -fs-- ^ SB 

214(2.4) 
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TABLE D8.5 (continued) 

Public School Students’ Reports on Talking With 
Friends and Family About Reading 



1994 Trial Slate Assessment 


Almost Every Day 


Once or Twice a Week 


Less Than Weekly 


1994 


PARENTS' 
EDUCATION 
College graduate 

State 

Nation 

Some ed after HS 

State 

Nation 

HS graduate 

State 

Nation 

HS non-graduate 

State 

Nation 

1 don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 
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•1 :• . ^ : ll| 
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5 jk.fc -42 (a ,3)4^ i,y. 
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31 ( 1.4) 

221 (2.3) •' 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D8.6 

Public School Students ’ Reports on the Amount of 
Time Spent 'Watching Television Each Day 



1994 Trial State Assessment 












One Hour or Less 


Two Hours 


Three Hours 
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TABLE D8.6 (continued) 

Public School Students ’ Reports on the Amount of 
Time Spent Watching Television Each Day 



1994 Trial State Assessment 


One Hour or Less 


Two Hours 


Three Hours 




1994 






PARENTS' 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 
State 

Nation 

1 don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D8.6 (continued) 

Public School Students’ Reports on the Amount of 
Time Spent Watching Television Each Day 



1994 Trial State Assessment 


Four to Five Hours 


Six Hours or More 


1994 


TOTAL 

State 

Nation 

RACE/ ETHNICrTY 
White 
State 

Nation 

Hispanic 

State 

Nation 

American Indian 
State 

Nation 

TYPE OF 
LOCATION 
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Rural/Small Town 
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TABLE D8.6 (continued) 

Public School Students’ Reports on the Amount of 
Time Spent Watching Television Each Day 



1994 Trial State Assessment 


Four to Five Hours 


Six Hours or More 


1994 


PARENTS' 
EDUCATION 
College graduate 
State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non-graduate 
State 

Nation 

1 don’t know 

State 

Nation 

GENDER 

Male 

State 

Nation 

Female 

State 

Nation 
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7(1.0) 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). *** Sample size is insufficient to permit a reliable estimate. 
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